-- Logs begin at Thu 2022-10-06 07:21:42 UTC, end at Thu 2022-10-06 08:40:08 UTC. -- Oct 06 08:04:17.185754 dv-cinder-860212-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 08:04:17.194002 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 08:04:17 2022] *** Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: nodename: dv-cinder-860212-3-iscsi Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: machine: x86_64 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: clock source: unix Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: pcre jit disabled Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: detected number of CPU cores: 4 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: current working directory: / Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: detected binary path: /usr/bin/uwsgi-core Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: your processes number limit is 47680 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: your memory page size is 4096 bytes Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: detected max file descriptor number: 2048 Oct 06 08:04:17.197374 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: lock engine: pthread robust mutexes Oct 06 08:04:17.198706 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: thunder lock: enabled Oct 06 08:04:17.198706 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 08:04:17.198706 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 08:04:17.237103 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: Python main interpreter initialized at 0x56211db6e9c0 Oct 06 08:04:17.237103 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: python threads support enabled Oct 06 08:04:17.237103 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: your server socket listen backlog is limited to 100 connections Oct 06 08:04:17.237103 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: your mercy for graceful operations on workers is 90 seconds Oct 06 08:04:17.237502 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 08:04:17.237502 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: *** Operational MODE: preforking *** Oct 06 08:04:17.237779 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: *** uWSGI is running in multiple interpreter mode *** Oct 06 08:04:17.237779 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: spawned uWSGI master process (pid: 106015) Oct 06 08:04:17.237985 dv-cinder-860212-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 08:04:17.242962 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: spawned uWSGI worker 1 (pid: 106016, cores: 1) Oct 06 08:04:17.242962 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: spawned uWSGI worker 2 (pid: 106017, cores: 1) Oct 06 08:04:17.242962 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 08:04:17.903382 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 08:04:17.907895 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 08:04:18.987656 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:04:18.987656 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: from cryptography.utils import int_from_bytes Oct 06 08:04:18.988251 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:04:18.988251 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: from cryptography.utils import int_from_bytes Oct 06 08:04:18.989617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:04:18.989617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: from cryptography.utils import int_from_bytes Oct 06 08:04:18.990086 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:04:18.990086 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: from cryptography.utils import int_from_bytes Oct 06 08:04:21.484944 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 08:04:21.485497 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 08:04:21.485702 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 08:04:21.486058 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 08:04:21.486309 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 08:04:21.486749 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.487159 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.487475 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.487784 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 08:04:21.488161 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.488261 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 08:04:21.488343 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.488429 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.488556 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 08:04:21.488694 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.488917 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 08:04:21.489003 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.489171 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 08:04:21.489311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.489561 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.489663 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.489865 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.489950 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490181 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-3-iscsi {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490269 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490495 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490643 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490793 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.490923 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491119 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491263 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491431 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491561 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491728 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.491858 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492040 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492181 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492314 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492441 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492608 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492814 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.492976 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-3-iscsi {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.494084 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.494291 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.494481 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.494680 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.494859 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495406 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495589 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495768 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.495768 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.496159 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.496159 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.497104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.497104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.497444 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.497739 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.497935 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.498116 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.498295 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.498513 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-3-iscsi {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.498714 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.498891 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499073 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499260 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499432 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499598 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499764 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.499764 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500022 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500189 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500336 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500533 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500663 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500787 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500946 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.500946 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501210 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-3-iscsi {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501336 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501469 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501595 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501719 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501855 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.501981 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502268 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502404 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502538 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502662 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502786 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.502909 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503078 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503206 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503339 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503713 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503840 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.503975 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504101 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504237 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504237 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504489 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504614 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.504818 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505019 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505148 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505273 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505398 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505530 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505668 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505794 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.505926 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506051 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506177 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506310 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506436 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506560 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506693 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506819 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.506957 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507098 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507226 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507360 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507493 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507624 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507758 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.507884 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508008 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508144 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508278 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508404 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508538 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508672 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508803 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.508929 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509052 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509186 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509320 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509445 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509569 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509693 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509823 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.509961 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510103 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510103 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510339 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510339 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510590 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510728 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510854 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.510991 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511117 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511253 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511380 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511517 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511633 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511760 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.511885 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512009 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512211 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512425 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512613 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512752 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.512879 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513011 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513146 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513272 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513397 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513522 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513658 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513792 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.513927 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514052 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514177 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514312 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514438 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514564 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514702 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514829 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.514980 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515121 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515249 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515373 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515508 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515634 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515634 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.515885 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516147 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516273 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516405 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516531 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516656 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516787 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.516921 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517047 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517171 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517295 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517419 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517550 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517685 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517811 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.517943 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518108 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518240 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518401 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518541 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518708 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.518838 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519043 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519176 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519344 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519493 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519643 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519775 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.519940 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520072 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520239 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520377 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520539 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520675 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520832 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.520959 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521128 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521268 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521429 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521564 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521722 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.521851 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522018 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522149 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522326 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522457 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522623 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522752 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.522918 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523249 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523384 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523540 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523668 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523838 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.523969 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524151 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524278 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524447 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524576 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524742 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.524873 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525036 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525166 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525329 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525459 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525624 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525756 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.525919 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526056 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526212 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526342 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526506 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526637 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526796 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.526925 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527128 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527268 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527441 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527569 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527760 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.527890 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528061 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528204 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528355 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528484 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528654 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528781 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.528958 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.529165 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.529307 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.529434 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.529566 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.529692 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.529817 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.529951 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.530137 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.530268 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.530459 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.530588 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.530760 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.531009 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.531225 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.531427 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.531640 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.531897 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.532125 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:04:21.532332 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.532536 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.532743 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.532743 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533113 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533262 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533392 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533516 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533641 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533765 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.533901 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534029 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534029 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534263 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534395 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534528 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534660 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.534785 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.535159 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.535313 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.535480 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.535608 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.535792 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.536430 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.536576 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.536704 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.536838 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.536972 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537108 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537242 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537369 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537369 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537605 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537731 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.537912 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.538143 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.538287 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.538506 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.538779 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.538908 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.539154 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.540786 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.541045 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.541171 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.541307 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.543302 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.543969 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544102 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544247 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544378 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544505 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544505 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544754 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544895 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.544895 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545132 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545256 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545390 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545517 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545650 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545784 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.545964 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546091 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546224 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546351 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546475 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546600 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546600 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546833 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546987 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.546987 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547225 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547354 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547479 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547622 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547622 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.547867 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548000 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548000 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548236 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548370 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548497 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548621 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548752 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.548877 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549001 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549135 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549268 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549393 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549524 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549657 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549783 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.549916 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550043 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550168 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550292 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550415 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550548 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550680 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550805 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.550929 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551210 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551347 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551474 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551598 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551722 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.551886 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552013 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552013 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552266 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552390 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552515 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552640 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552763 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.552905 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553031 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553155 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553288 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553429 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553568 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553702 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553835 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.553961 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554096 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554222 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554429 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554558 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554691 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554818 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.554961 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555088 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555226 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555355 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555487 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555620 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555746 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.555878 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556006 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556141 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556275 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556403 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556528 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556661 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.556787 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557018 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557361 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557476 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557602 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557738 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557864 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.557989 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558114 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558248 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558383 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558520 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558654 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558791 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.558924 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.559134 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.559750 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.559891 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560020 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560144 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560276 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560276 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560534 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560670 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560796 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.560920 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561057 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561183 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561317 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561450 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561583 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561722 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561849 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.561974 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562107 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562242 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562367 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562565 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562741 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.562871 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563031 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563211 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563342 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563606 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563749 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.563921 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564050 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564229 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564367 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564531 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564660 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564835 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.564970 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565135 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565263 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565437 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565571 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565735 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.565873 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566038 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566166 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566338 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566467 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566637 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566772 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.566962 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567094 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567260 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567404 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567570 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567698 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.567867 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568005 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568174 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568316 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568473 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568602 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568774 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.568910 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569074 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569213 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569404 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569532 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569706 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.569834 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570008 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570146 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570309 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570440 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570610 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570741 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.570914 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571080 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571240 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571362 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571548 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571677 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571851 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.571989 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572159 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572296 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572459 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572589 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572773 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.572912 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573075 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573206 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573385 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573514 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573680 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573816 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.573985 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574115 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574304 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574432 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574638 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574779 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.574992 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575125 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575273 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575420 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575585 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575715 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.575888 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576019 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576191 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576331 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576493 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576623 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576789 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.576919 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577085 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577224 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577386 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577516 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577692 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577830 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.577995 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578134 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578295 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578426 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578590 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578723 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.578896 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579058 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579220 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579358 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579516 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579647 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579811 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.579942 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580113 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580250 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580425 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580556 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580727 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.580858 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581028 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581158 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581341 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581470 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581637 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581767 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.581933 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582062 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582246 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582383 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582584 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582721 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.582846 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583051 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583188 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583328 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583463 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583595 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583730 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.583856 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584036 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584175 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584334 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584464 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584647 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584783 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.584959 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585097 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585261 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585399 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585565 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585765 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.585894 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586027 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586154 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586277 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586457 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586586 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586759 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.586887 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587082 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587210 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587388 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587516 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587691 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587822 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.587995 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588117 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588298 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588426 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588612 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588742 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.588914 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589042 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589215 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589342 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589518 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589648 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589813 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.589943 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.590117 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.590310 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.590481 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.590608 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.590735 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591035 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591178 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591360 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591493 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591667 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591798 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.591977 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592109 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592295 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592425 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592606 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592746 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.592919 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593049 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593229 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593374 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593535 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593663 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593832 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.593962 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594132 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594273 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594437 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594568 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594736 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.594866 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595064 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595210 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595360 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595499 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595656 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595786 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.595951 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596082 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596251 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596395 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596545 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596682 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596842 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.596980 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597136 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597274 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597434 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597571 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597740 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.597883 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598037 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598304 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598435 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598627 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598764 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.598960 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599265 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599395 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599561 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599693 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599857 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.599997 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600151 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600285 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600484 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600624 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600781 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.600911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601109 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601240 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601429 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601568 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601734 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.601873 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602040 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602169 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602335 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602472 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602638 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602767 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.602950 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603081 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603253 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603396 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603553 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603684 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603854 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.603984 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604154 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604285 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604454 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604584 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604756 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.604885 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605058 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605201 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605360 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605490 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605659 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.605790 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.606511 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.606712 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.606883 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607069 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607196 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607321 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607461 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607589 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607715 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607842 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.607967 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608106 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608234 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608421 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608560 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608726 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.608857 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609063 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609191 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609364 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609494 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609659 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609789 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.609967 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610097 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610263 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610392 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610558 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610688 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.610853 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611003 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611177 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611318 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611478 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611626 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611773 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.611895 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612214 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612387 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612562 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612723 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.612852 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613013 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613148 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613281 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613416 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613543 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613674 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613800 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.613931 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614099 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614239 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614414 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614544 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614727 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.614856 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615052 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615184 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615338 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615467 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615633 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615762 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.615931 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616074 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616209 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616342 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616513 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616635 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616808 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.616946 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617103 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617234 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617397 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617527 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617691 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617822 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.617986 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618124 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618286 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618415 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618586 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618714 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.618882 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619029 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619205 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619348 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619499 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619629 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619818 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.619946 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620117 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620253 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620417 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620546 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620726 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.620855 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.621028 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.621168 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.621331 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.621512 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622187 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622321 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622512 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622642 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622829 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.622982 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623158 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623288 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623468 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623600 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623770 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.623899 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624075 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624204 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624377 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624514 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624684 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624813 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.624987 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625123 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625289 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625419 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625589 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625720 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.625892 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626030 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626195 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626324 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626508 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626643 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626807 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.626982 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627133 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627261 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627438 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627576 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627739 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.627876 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.628040 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.628167 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.628343 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.628719 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.628897 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629040 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629204 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629332 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629508 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629644 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629811 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.629942 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630112 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630242 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630411 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630539 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630714 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.630845 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631039 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631184 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631340 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631469 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631657 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631794 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.631957 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632242 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632373 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632546 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632684 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632840 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.632969 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633142 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633286 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633441 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633572 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633763 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.633891 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634083 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634222 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634405 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634535 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634709 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.634846 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635039 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635248 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635378 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635509 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635636 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635768 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.635909 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636048 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636210 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636340 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636531 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636659 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636844 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.636984 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637207 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637340 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637523 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637653 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637820 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.637964 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638100 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638235 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638405 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638535 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638715 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.638845 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639036 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639167 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639335 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639465 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639631 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639763 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.639942 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640080 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640237 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640376 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640539 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640668 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640849 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.640994 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.641158 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.641295 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.641517 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.641645 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.641858 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642055 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642185 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642321 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642459 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642587 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642769 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.642898 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643105 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643248 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643420 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643549 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643716 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.643843 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644020 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644157 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644322 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644448 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644643 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644772 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.644960 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645090 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645267 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645395 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645575 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645703 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.645872 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646011 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646187 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646316 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646501 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646641 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646803 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.646931 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647132 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647262 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647436 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647573 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647760 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.647889 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648061 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648191 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648379 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648507 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.648860 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649034 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649164 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649335 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649463 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649638 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649776 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.649936 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650072 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650233 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650362 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650549 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650686 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.650849 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651020 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651179 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651307 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651483 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651621 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651787 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.651947 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652074 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652199 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652367 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652499 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652683 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.652905 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653042 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653170 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653309 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653438 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653599 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653737 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.653914 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654046 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654227 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654358 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654524 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654655 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.654844 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655004 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655173 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655357 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655488 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655685 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655815 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.655997 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656318 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656449 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656641 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656770 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.656967 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657103 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657238 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657365 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657553 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657692 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657860 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.657990 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658292 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658486 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658623 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658792 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.658923 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659119 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659261 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659428 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659566 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659739 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.659868 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660034 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660198 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660328 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660464 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660620 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660751 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.660915 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661046 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661213 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661353 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661510 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661641 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661810 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.661941 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662106 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662250 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662386 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662513 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662683 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.662815 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663018 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663168 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663305 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663433 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663616 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663747 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.663918 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664049 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664212 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664352 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664508 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664646 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664805 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.664937 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665135 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665430 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665561 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665749 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.665885 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666052 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666182 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666366 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666506 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666675 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.666805 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667002 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667129 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667454 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667618 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667749 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.667926 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.668056 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.668231 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.668875 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669051 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669174 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669340 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669553 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669685 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.669940 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670248 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670386 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670558 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670755 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.670886 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671099 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671231 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671407 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671549 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671712 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.671845 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672016 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672147 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672321 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672450 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672625 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672750 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.672928 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673059 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673230 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673360 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673532 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673663 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673832 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.673971 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674151 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674327 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674456 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674583 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674766 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.674898 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675110 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675250 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675419 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675556 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675724 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.675855 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676115 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676262 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676391 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676517 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676643 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676768 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.676938 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677072 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677235 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677376 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677541 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677672 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677848 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.677980 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678154 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678283 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678457 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678595 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678761 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.678994 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679143 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679326 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679457 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679641 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679773 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.679955 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680085 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680267 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680403 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680572 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680711 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.680882 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681012 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681194 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681325 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681531 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681661 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681788 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.681912 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682091 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682232 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682400 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682531 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682723 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.682908 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683080 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683224 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683415 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683545 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683731 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.683861 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.684115 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.684297 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.684574 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.684713 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.684896 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685026 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685221 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685351 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685521 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685651 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685818 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.685949 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686123 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686254 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686426 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686558 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686723 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.686853 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687044 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687175 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687353 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687485 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687653 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687797 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.687966 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688097 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688270 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688400 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688584 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688794 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.688930 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689115 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689253 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689424 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689554 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689740 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.689879 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690055 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690192 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690362 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690511 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690662 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690799 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.690996 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.691142 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.691299 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.691572 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.691705 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.691889 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692019 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692189 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692317 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692486 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692618 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692783 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.692906 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693087 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693218 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693388 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693519 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693682 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693821 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.693985 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694128 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694279 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694409 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694595 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694725 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.694892 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695077 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695206 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695332 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695500 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695630 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695805 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.695950 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696102 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696233 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696398 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696528 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696695 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696834 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.696990 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.697247 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.697385 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.697575 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.697712 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.697876 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698014 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698172 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698303 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698475 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698619 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698820 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.698973 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.699147 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.699277 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.699444 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700101 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700305 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700434 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700663 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700793 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.700964 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701109 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701275 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701412 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701578 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701708 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.701893 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702025 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702199 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702329 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702504 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702636 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702843 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.702993 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.703178 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.703320 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.703509 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.703702 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.703843 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704027 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704157 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704342 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704473 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704666 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704829 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.704989 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705127 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705289 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705419 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705588 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705718 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.705884 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706021 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706186 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706323 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706488 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706618 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706788 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.706911 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707116 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707245 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707419 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707542 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707719 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.707854 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708021 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708151 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708323 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708455 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708625 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708756 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.708925 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709068 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709226 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709357 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709525 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709662 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709827 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.709970 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710126 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710263 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710425 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710565 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710728 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.710868 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711060 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711201 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711381 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711510 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711691 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.711822 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712000 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712222 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712353 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712560 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712701 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.712884 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713015 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713182 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713297 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713484 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713627 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713792 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.713923 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714112 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714245 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714414 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714551 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714709 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.714838 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.715062 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.715978 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716323 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716455 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716636 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716766 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.716948 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717088 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717261 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717391 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717573 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717703 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.717884 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718025 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718192 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718330 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718502 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718835 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.718987 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719139 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719280 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719450 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719581 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719760 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.719900 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720074 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720205 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720412 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720542 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720709 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.720845 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721008 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721139 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721455 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721621 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721752 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.721923 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722066 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722219 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722358 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722517 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722639 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.722820 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723015 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723151 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723283 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723433 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723563 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723729 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.723868 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724012 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724141 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724314 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724609 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724750 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.724905 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725045 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725200 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725331 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725494 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725624 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725787 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.725932 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726088 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726219 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726386 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726538 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726669 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.726850 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727043 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727186 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727343 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727482 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727639 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727805 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.727948 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728145 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728275 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728499 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728642 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728823 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.728953 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729134 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729263 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729439 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729743 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.729873 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730044 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730173 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730356 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730488 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730662 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.730791 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731012 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731147 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731319 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731612 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731743 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.731917 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732078 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732344 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732506 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732639 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732809 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.732946 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733113 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733251 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733412 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733541 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733713 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.733842 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734010 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734140 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734299 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734438 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734602 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.734905 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735241 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735381 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735532 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735663 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735835 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.735974 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736136 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736266 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736437 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736568 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736739 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.736872 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737066 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737194 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737367 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737510 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737670 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737802 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.737974 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738105 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738282 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738421 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738585 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738715 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.738888 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739056 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739365 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739529 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739667 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739842 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.739972 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740152 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740283 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740453 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740582 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740768 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.740897 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741076 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741206 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741387 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741518 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741696 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.741826 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742004 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742144 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742313 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742444 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742628 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742756 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.742974 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.743111 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.743256 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.743348 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.743498 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 08:04:21.743706 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.743881 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.744199 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.744512 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.744822 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.745148 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.745458 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.745768 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.746077 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.746389 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.747243 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.747560 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.747869 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.748180 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.748495 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.748808 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.749132 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.749462 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.749770 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.750093 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.750417 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.750758 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.751094 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.751438 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.751766 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.752079 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.752391 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.752693 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:04:21.752936 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 08:04:21.897891 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO dbcounter [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Registered counter for database nova_api Oct 06 08:04:21.906289 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO dbcounter [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Registered counter for database nova_api Oct 06 08:04:21.918620 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_db.sqlalchemy.engines [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:21.925287 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writer thread running {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:21.925878 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_db.sqlalchemy.engines [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:21.932239 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writer thread running {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:21.981703 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.context [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19a0419b-ae97-4662-abef-e84eaae985c7(cell1) {{(pid=106016) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 08:04:21.985625 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:04:21.986042 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:04:21.987600 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:04:21.988317 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:04:21.988756 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:04:21.989330 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.context [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19a0419b-ae97-4662-abef-e84eaae985c7(cell1) {{(pid=106017) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 08:04:21.990705 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:04:21.992681 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO dbcounter [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Registered counter for database nova_cell0 Oct 06 08:04:21.993181 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:04:21.993656 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:04:21.995236 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:04:21.995959 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:04:21.996404 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:04:21.997186 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO dbcounter [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Registered counter for database nova_cell1 Oct 06 08:04:21.999117 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_concurrency.lockutils [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106017) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:04:22.001113 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO dbcounter [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Registered counter for database nova_cell0 Oct 06 08:04:22.004988 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_db.sqlalchemy.engines [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.005516 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO dbcounter [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Registered counter for database nova_cell1 Oct 06 08:04:22.006794 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_db.sqlalchemy.engines [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.013140 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_db.sqlalchemy.engines [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.014000 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writer thread running {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.014496 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_db.sqlalchemy.engines [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.016806 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writer thread running {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.020834 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writer thread running {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.023068 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writer thread running {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.166238 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO dbcounter [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Registered counter for database nova_cell0 Oct 06 08:04:22.169277 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO dbcounter [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Registered counter for database nova_cell0 Oct 06 08:04:22.173889 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_db.sqlalchemy.engines [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.178077 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG oslo_db.sqlalchemy.engines [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:04:22.178673 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writer thread running {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.182334 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writer thread running {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:04:22.617721 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: WARNING keystonemiddleware.auth_token [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:04:22.626388 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: WARNING keystonemiddleware.auth_token [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:04:22.647263 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: WARNING keystonemiddleware.auth_token [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:04:22.655295 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: WARNING keystonemiddleware.auth_token [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:04:22.968251 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: WARNING keystonemiddleware.auth_token [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:04:22.974109 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: WARNING keystonemiddleware.auth_token [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:04:22.979537 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56211db6e9c0 pid: 106016 (default app) Oct 06 08:04:22.982307 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:04:22.983503 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002458 Oct 06 08:04:22.983900 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Thu Oct 6 08:04:22 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:04:22.997353 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: WARNING keystonemiddleware.auth_token [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:04:23.003316 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: WARNING keystonemiddleware.auth_token [None req-a0364841-5987-42c4-ba13-35f5416d13ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:04:23.008762 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56211db6e9c0 pid: 106017 (default app) Oct 06 08:05:48.687507 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:05:48.689362 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002751 Oct 06 08:05:48.690405 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:05:48.703411 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_api:SELECT=3 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:48.704840 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_cell1:SELECT=3 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:48.705645 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_cell0:SELECT=3 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:48.708000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:49.582684 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-bad5558c-44db-4af2-9c6a-47d40838713a admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:05:49.613728 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-bad5558c-44db-4af2-9c6a-47d40838713a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915520 Oct 06 08:05:49.614978 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Oct 6 08:05:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:05:52.273423 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:05:52.274409 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-72ee3a49-4855-4d5d-9287-609e7882de14 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Oct 06 08:05:52.275078 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:05:52.710419 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-b944afbf-8c27-4a2b-84be-9c8298a06831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "ram": 256, "rxtx_factor": 1.0}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:05:52.809290 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-b944afbf-8c27-4a2b-84be-9c8298a06831 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.528353 Oct 06 08:05:52.810317 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:05:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:05:52.824186 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=3 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:52.825080 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_cell1:SELECT=3 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:52.827444 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_cell0:SELECT=3 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:52.827780 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:05:53.042343 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-613c482f-b0a1-4ae2-b948-98d2aeec6152 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:05:53.228123 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-613c482f-b0a1-4ae2-b948-98d2aeec6152 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.409672 Oct 06 08:05:53.228836 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Oct 6 08:05:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:05:55.871637 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-b944afbf-8c27-4a2b-84be-9c8298a06831 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:05:55.873131 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-b944afbf-8c27-4a2b-84be-9c8298a06831 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 Oct 06 08:05:55.874038 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:05:55 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:05:56.568594 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-66a90423-3b82-40f1-8359-df7ffce84041 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:05:56.715818 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-66a90423-3b82-40f1-8359-df7ffce84041 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.833050 Oct 06 08:05:56.716530 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:05:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:05:56.728823 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-cc6eec5c-6d92-4275-abef-6082389509ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:05:56.864034 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-cc6eec5c-6d92-4275-abef-6082389509ad admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139219 Oct 06 08:05:56.864833 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Oct 6 08:05:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:05:59.530644 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-66a90423-3b82-40f1-8359-df7ffce84041 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:05:59.531613 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-66a90423-3b82-40f1-8359-df7ffce84041 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 06 08:05:59.532030 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:05:59.976290 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-cfedb17e-4fcf-47a9-8c81-e3428d7225c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "ram": 1024, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:00.145530 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-cfedb17e-4fcf-47a9-8c81-e3428d7225c3 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.607188 Oct 06 08:06:00.149097 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:05:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:00.158525 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-6da3320a-cd0d-4c3a-9f62-9c3217d25899 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:00.268588 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-6da3320a-cd0d-4c3a-9f62-9c3217d25899 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113813 Oct 06 08:06:00.269168 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Oct 6 08:06:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:02.997521 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-cfedb17e-4fcf-47a9-8c81-e3428d7225c3 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:02.998528 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-cfedb17e-4fcf-47a9-8c81-e3428d7225c3 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 06 08:06:02.998923 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:03.435317 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-0a2a11f4-9295-4a13-a7d7-f1071c679737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:03.519765 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-0a2a11f4-9295-4a13-a7d7-f1071c679737 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514538 Oct 06 08:06:03.520542 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:03.532834 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-315f0016-5205-4c89-89c7-469a217f2bcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:03.658177 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-315f0016-5205-4c89-89c7-469a217f2bcc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129041 Oct 06 08:06:03.658850 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Oct 6 08:06:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:06.522362 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-0a2a11f4-9295-4a13-a7d7-f1071c679737 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:06.523401 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-0a2a11f4-9295-4a13-a7d7-f1071c679737 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Oct 06 08:06:06.523832 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:06.972908 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:07.043278 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512034 Oct 06 08:06:07.043833 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:07.057780 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-8488dd7c-84dd-4102-ae4f-488899e530ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:07.132256 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-8488dd7c-84dd-4102-ae4f-488899e530ca admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078848 Oct 06 08:06:07.133016 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Thu Oct 6 08:06:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:10.082651 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:10.086232 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001801 Oct 06 08:06:10.086232 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:10.558695 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-77f5741f-6ecf-4c6e-b286-cdda3959a3f2 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:10.589491 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-77f5741f-6ecf-4c6e-b286-cdda3959a3f2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497001 Oct 06 08:06:10.590174 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Oct 6 08:06:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:06:13.351542 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:13.353242 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-1012b479-800e-409d-a997-ec38d1fac6d6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Oct 06 08:06:13.353691 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:13.757064 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-710bb3a6-d73f-4f74-a190-6b09be56b5ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "disk": 1, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:13.832030 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-710bb3a6-d73f-4f74-a190-6b09be56b5ec admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472130 Oct 06 08:06:13.832664 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 08:06:13.845113 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-515b86d0-91a6-4ac3-83b0-eb66a9ad4152 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:13.928831 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-515b86d0-91a6-4ac3-83b0-eb66a9ad4152 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087294 Oct 06 08:06:13.929400 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Oct 6 08:06:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:16.577437 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-710bb3a6-d73f-4f74-a190-6b09be56b5ec admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:16.578443 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-710bb3a6-d73f-4f74-a190-6b09be56b5ec admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 06 08:06:16.578855 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:16.976646 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-064eb375-34af-4d2f-bdfa-47b79374aa0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:17.053431 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-064eb375-34af-4d2f-bdfa-47b79374aa0f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468496 Oct 06 08:06:17.054393 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 06 08:06:17.067746 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-46ba9a2c-6671-4536-85a0-ffc98be3ff7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:17.159872 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-46ba9a2c-6671-4536-85a0-ffc98be3ff7d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095789 Oct 06 08:06:17.160705 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Oct 6 08:06:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:19.935336 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-064eb375-34af-4d2f-bdfa-47b79374aa0f admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:19.936461 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-064eb375-34af-4d2f-bdfa-47b79374aa0f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Oct 06 08:06:19.936948 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:20.399991 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-91d6e34b-d85e-4a31-a0d2-535afa3341f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:20.499798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-91d6e34b-d85e-4a31-a0d2-535afa3341f9 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.556407 Oct 06 08:06:20.500661 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:20.516859 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2a8b0a7b-4549-43cf-b96f-578ccb638241 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:20.520410 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:06:20.600492 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-2a8b0a7b-4549-43cf-b96f-578ccb638241 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089222 Oct 06 08:06:20.614973 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Oct 6 08:06:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:23.311119 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-91d6e34b-d85e-4a31-a0d2-535afa3341f9 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:23.312146 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-91d6e34b-d85e-4a31-a0d2-535afa3341f9 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Oct 06 08:06:23.312996 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:06:23.772151 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-57b2cc6d-2041-4244-892a-8a2b5f787ba5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "vcpus": 4, "ram": 8192, "id": "4", "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:23.892085 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-57b2cc6d-2041-4244-892a-8a2b5f787ba5 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.573139 Oct 06 08:06:23.899890 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:23.906656 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-77693d4b-2805-48fd-9d34-4345c992f062 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:23.911523 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:06:24.026920 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-77693d4b-2805-48fd-9d34-4345c992f062 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124326 Oct 06 08:06:24.028104 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Oct 6 08:06:23 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:26.700457 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-57b2cc6d-2041-4244-892a-8a2b5f787ba5 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:26.703034 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-57b2cc6d-2041-4244-892a-8a2b5f787ba5 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 06 08:06:26.703738 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:27.268078 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "swap": 0, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:27.376044 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.665296 Oct 06 08:06:27.389099 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Thu Oct 6 08:06:26 2022] POST /compute/v2.1/flavors => generated 408 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:27.394796 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-75b4d9c7-32e2-47f4-8954-85a80418ba0a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:27.490524 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-75b4d9c7-32e2-47f4-8954-85a80418ba0a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100007 Oct 06 08:06:27.494995 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Thu Oct 6 08:06:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:06:44.368993 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:44.370022 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 06 08:06:44.370420 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:44.381892 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:06:44.765096 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2ae8d241-fc1b-4b0a-b71b-be50e6fe5ca3 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:44.783649 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-2ae8d241-fc1b-4b0a-b71b-be50e6fe5ca3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.406423 Oct 06 08:06:44.784124 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Oct 6 08:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:06:46.101325 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:46.102311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-88111cbc-d6a4-4a97-a402-3d2aba25b188 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 06 08:06:46.102706 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:46.628699 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2d4bf8d3-d7a9-4863-ac46-590f415e286f admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:46.634332 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.wsgi [None req-2d4bf8d3-d7a9-4863-ac46-590f415e286f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2d4bf8d3-d7a9-4863-ac46-590f415e286f admin admin] Request method failure captured: Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept: application/json Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept-Encoding: gzip, deflate Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Connection: keep-alive Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Content-Length: 0 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Host: 10.222.0.30 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-System-Scope: None Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: User-Agent: python-novaclient Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Auth-Token: gAAAAABjPoyV9X1pDEytb7si1HrRDbGFrKszZVj39wJmFXLjzFwMpq0_9VCEggc5-DRjIiRxUGARNjavcahJbwspImLLa-DsI0F94CKUNwxqNZuXs2BYPI6FHxOc-aFeE-QCpo7mHJ7UqunSBfYvUhmRmd-0PqjsiEAx5ZhYfFkZ6uoeQ7hTu18 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Id: None Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Name: None Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Identity-Status: Confirmed Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Is-Admin-Project: True Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Id: default Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Name: Default Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Name: admin Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Role: reader,member,admin Oct 06 08:06:46.637824 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Roles: reader,member,admin Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant: admin Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Name: admin Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User: admin Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Id: default Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Name: Default Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Name: admin Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: method: > Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: exception: Flavor 42 could not be found. Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: action_args: {'id': '42'} Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:46.639466 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:46.640384 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.641780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2d4bf8d3-d7a9-4863-ac46-590f415e286f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:46.643119 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-2d4bf8d3-d7a9-4863-ac46-590f415e286f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398957 Oct 06 08:06:46.643119 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Oct 6 08:06:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:46.648967 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-aa22e054-9deb-4b60-a4ba-05f9b732f1cc admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:46.653270 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:06:46.671947 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-aa22e054-9deb-4b60-a4ba-05f9b732f1cc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026516 Oct 06 08:06:46.672483 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:06:46.682928 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-6bbea933-9297-4bfc-bc98-64cb8c9c750e admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:46.705480 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-6bbea933-9297-4bfc-bc98-64cb8c9c750e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026937 Oct 06 08:06:46.706022 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:06:46.716108 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-65449126-0f98-44ae-99b6-67c9c89d9a50 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:46.721427 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.wsgi [None req-65449126-0f98-44ae-99b6-67c9c89d9a50 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-65449126-0f98-44ae-99b6-67c9c89d9a50 admin admin] Request method failure captured: Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept: application/json Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept-Encoding: gzip, deflate Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Connection: keep-alive Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Content-Length: 0 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Host: 10.222.0.30 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-System-Scope: None Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: User-Agent: python-novaclient Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Auth-Token: gAAAAABjPoyV9X1pDEytb7si1HrRDbGFrKszZVj39wJmFXLjzFwMpq0_9VCEggc5-DRjIiRxUGARNjavcahJbwspImLLa-DsI0F94CKUNwxqNZuXs2BYPI6FHxOc-aFeE-QCpo7mHJ7UqunSBfYvUhmRmd-0PqjsiEAx5ZhYfFkZ6uoeQ7hTu18 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Id: None Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Name: None Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Identity-Status: Confirmed Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Is-Admin-Project: True Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Id: default Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Name: Default Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Name: admin Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Role: reader,member,admin Oct 06 08:06:46.724733 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Roles: reader,member,admin Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant: admin Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Name: admin Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User: admin Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Id: default Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Name: Default Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Name: admin Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: method: > Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: exception: Flavor 42 could not be found. Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: action_args: {'id': '42'} Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:46.729376 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:46.731010 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:46.732311 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-65449126-0f98-44ae-99b6-67c9c89d9a50 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:46.733545 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-65449126-0f98-44ae-99b6-67c9c89d9a50 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014405 Oct 06 08:06:46.733545 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Oct 6 08:06:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:47.946780 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-6bbea933-9297-4bfc-bc98-64cb8c9c750e admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:47.947830 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-6bbea933-9297-4bfc-bc98-64cb8c9c750e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 06 08:06:47.948232 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:48.485839 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a86c948d-305a-4c09-9942-2d603102d2ca admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:48.490819 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.wsgi [None req-a86c948d-305a-4c09-9942-2d603102d2ca admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a86c948d-305a-4c09-9942-2d603102d2ca admin admin] Request method failure captured: Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept: application/json Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept-Encoding: gzip, deflate Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Connection: keep-alive Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Content-Length: 0 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Host: 10.222.0.30 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-System-Scope: None Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: User-Agent: python-novaclient Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Auth-Token: gAAAAABjPoyXiRlx7kmkV_ehZx8_NEyqGjcLoMFnTLwTs4qNI4fpDTb8nAcMs23QclFGAOX-2CW21AB7hoeQVF8LhF5BGgdF860qfznPyyjpJh-5sOIaAJzwY4e8jXSf3Bh9W_RaGNB92dx5Gde86SpSw1Glpff1DY-cjUMGX7bTJJNr8zhLTgo Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Id: None Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Name: None Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Identity-Status: Confirmed Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Is-Admin-Project: True Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Id: default Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Name: Default Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Name: admin Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Role: reader,member,admin Oct 06 08:06:48.492439 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Roles: reader,member,admin Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant: admin Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Name: admin Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User: admin Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Id: default Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Name: Default Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Name: admin Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: method: > Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: exception: Flavor 84 could not be found. Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: action_args: {'id': '84'} Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:48.493798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:48.495130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.496579 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a86c948d-305a-4c09-9942-2d603102d2ca admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:48.497937 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-a86c948d-305a-4c09-9942-2d603102d2ca admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.406901 Oct 06 08:06:48.497937 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Oct 6 08:06:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:48.503988 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-cdb99664-d2c1-463b-ad08-361b66af9dfc admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:48.519145 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-cdb99664-d2c1-463b-ad08-361b66af9dfc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018700 Oct 06 08:06:48.519697 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:06:48.529753 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-d440f5f9-707e-477b-a356-563433937540 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:48.545543 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-d440f5f9-707e-477b-a356-563433937540 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019952 Oct 06 08:06:48.546060 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:06:48.555133 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-4afadfff-2c77-439f-a896-20d3fe132ffd admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:48.560127 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.wsgi [None req-4afadfff-2c77-439f-a896-20d3fe132ffd admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-4afadfff-2c77-439f-a896-20d3fe132ffd admin admin] Request method failure captured: Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept: application/json Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept-Encoding: gzip, deflate Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Connection: keep-alive Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Content-Length: 0 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Host: 10.222.0.30 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-System-Scope: None Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: User-Agent: python-novaclient Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Auth-Token: gAAAAABjPoyXiRlx7kmkV_ehZx8_NEyqGjcLoMFnTLwTs4qNI4fpDTb8nAcMs23QclFGAOX-2CW21AB7hoeQVF8LhF5BGgdF860qfznPyyjpJh-5sOIaAJzwY4e8jXSf3Bh9W_RaGNB92dx5Gde86SpSw1Glpff1DY-cjUMGX7bTJJNr8zhLTgo Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Id: None Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Name: None Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Identity-Status: Confirmed Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Is-Admin-Project: True Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Id: default Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Name: Default Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Name: admin Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Role: reader,member,admin Oct 06 08:06:48.561617 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Roles: reader,member,admin Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant: admin Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Name: admin Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User: admin Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Id: default Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Name: Default Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Name: admin Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: method: > Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: exception: Flavor 84 could not be found. Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: action_args: {'id': '84'} Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:48.563205 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:48.564163 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:48.565478 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-4afadfff-2c77-439f-a896-20d3fe132ffd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:48.566665 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-4afadfff-2c77-439f-a896-20d3fe132ffd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011254 Oct 06 08:06:48.566665 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Thu Oct 6 08:06:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:49.783955 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-d440f5f9-707e-477b-a356-563433937540 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:49.784940 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-d440f5f9-707e-477b-a356-563433937540 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Oct 06 08:06:49.785329 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:50.315575 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2335a6e6-906c-4edd-bc90-529dbfcb3486 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:50.321412 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.wsgi [None req-2335a6e6-906c-4edd-bc90-529dbfcb3486 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2335a6e6-906c-4edd-bc90-529dbfcb3486 admin admin] Request method failure captured: Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept: application/json Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Accept-Encoding: gzip, deflate Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Connection: keep-alive Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Content-Length: 0 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Host: 10.222.0.30 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Openstack-System-Scope: None Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: User-Agent: python-novaclient Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Auth-Token: gAAAAABjPoyZOjF9EKBRCGj0xbIfpbifq2mb5UKC-wwbChbbEi0HbWbairXiQNfQkqhBUyL2F-MTUQp-JiLLU8X1KuhA01bO8nLWcvekzazAu_mgUK4-ov2fisfewZ1t58zwbMFxMG58L3ByEDd2jUpjksuboCukCjLO1mrECMD1cyqWBO7CTIo Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Id: None Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Domain-Name: None Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Identity-Status: Confirmed Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Is-Admin-Project: True Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Id: default Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Domain-Name: Default Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Project-Name: admin Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Role: reader,member,admin Oct 06 08:06:50.322911 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Roles: reader,member,admin Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant: admin Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-Tenant-Name: admin Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User: admin Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Id: default Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Domain-Name: Default Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: X-User-Name: admin Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: method: > Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: exception: Flavor 451 could not be found. Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: action_args: {'id': '451'} Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:50.325070 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:50.326000 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.327267 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-2335a6e6-906c-4edd-bc90-529dbfcb3486 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106017) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:50.328805 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-2335a6e6-906c-4edd-bc90-529dbfcb3486 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.400472 Oct 06 08:06:50.328805 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:06:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:50.334689 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-47851d06-40b2-413e-92dc-5adba555f727 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:50.350384 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-47851d06-40b2-413e-92dc-5adba555f727 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019213 Oct 06 08:06:50.350908 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:06:50.360836 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:50.375550 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018212 Oct 06 08:06:50.376094 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Thu Oct 6 08:06:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:06:50.385248 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-acb4f710-11aa-408d-b4f2-a59cf684da24 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:50.390959 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.wsgi [None req-acb4f710-11aa-408d-b4f2-a59cf684da24 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-acb4f710-11aa-408d-b4f2-a59cf684da24 admin admin] Request method failure captured: Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept: application/json Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Accept-Encoding: gzip, deflate Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Connection: keep-alive Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Content-Length: 0 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Host: 10.222.0.30 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-Api-Version: compute 2.92 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Openstack-System-Scope: None Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: User-Agent: python-novaclient Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Auth-Token: gAAAAABjPoyZOjF9EKBRCGj0xbIfpbifq2mb5UKC-wwbChbbEi0HbWbairXiQNfQkqhBUyL2F-MTUQp-JiLLU8X1KuhA01bO8nLWcvekzazAu_mgUK4-ov2fisfewZ1t58zwbMFxMG58L3ByEDd2jUpjksuboCukCjLO1mrECMD1cyqWBO7CTIo Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Id: None Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Domain-Name: None Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Identity-Status: Confirmed Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Is-Admin-Project: True Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Openstack-Nova-Api-Version: 2.92 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Id: default Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Domain-Name: Default Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Project-Name: admin Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Role: reader,member,admin Oct 06 08:06:50.392466 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Roles: reader,member,admin Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f2d30f50f03441f1a79068b287cb95c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant: admin Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Id: f2d30f50f03441f1a79068b287cb95c1 Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-Tenant-Name: admin Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User: admin Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Id: default Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Domain-Name: Default Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Id: 93747f497a1f4adcb4b8ddb03adfe01c Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: X-User-Name: admin Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: method: > Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: exception: Flavor 451 could not be found. Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: action_args: {'id': '451'} Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:06:50.393812 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:50.394632 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: ERROR nova.api.openstack.wsgi Oct 06 08:06:50.395732 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-acb4f710-11aa-408d-b4f2-a59cf684da24 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:06:50.396783 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-acb4f710-11aa-408d-b4f2-a59cf684da24 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012055 Oct 06 08:06:50.396783 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:06:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 06 08:06:51.633020 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:51.634031 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 06 08:06:51.634430 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:52.167981 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-4eabcc13-2f0b-4961-9ebb-e65725853f44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:52.239663 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-4eabcc13-2f0b-4961-9ebb-e65725853f44 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.465898 Oct 06 08:06:52.240194 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Oct 6 08:06:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:53.470120 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:53.471176 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 06 08:06:53.471576 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:53.996300 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a2a79c5d-9c37-4358-899e-231b7876b1c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:54.100525 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-a2a79c5d-9c37-4358-899e-231b7876b1c0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.484476 Oct 06 08:06:54.101066 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Oct 6 08:06:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:55.328546 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:55.329547 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Oct 06 08:06:55.329967 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:55.852624 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-fbf7b832-9ae2-44de-916f-f85f82b79a30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:55.942833 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-fbf7b832-9ae2-44de-916f-f85f82b79a30 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.476749 Oct 06 08:06:55.943414 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Oct 6 08:06:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:57.166465 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:57.167743 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Oct 06 08:06:57.168134 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:57.699798 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-b6c524ad-1b6e-404c-b42b-3af60404f893 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:06:57.826196 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-b6c524ad-1b6e-404c-b42b-3af60404f893 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.521171 Oct 06 08:06:57.826748 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Thu Oct 6 08:06:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:06:59.061706 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:59.062757 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 06 08:06:59.063203 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:06:59.586064 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-0121e144-fb58-4114-9e6a-eb13b0f5b9e7 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:06:59.607459 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-0121e144-fb58-4114-9e6a-eb13b0f5b9e7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404633 Oct 06 08:06:59.607985 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Thu Oct 6 08:06:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:07:57.145084 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.146096 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-c4734e10-23af-496a-a7fa-e3ed4744d572 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 06 08:07:57.146497 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:07:57.157570 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:07:57.535365 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a4426b9c-25d6-4bec-892e-3fe85232f25b admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.557468 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-a4426b9c-25d6-4bec-892e-3fe85232f25b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404317 Oct 06 08:07:57.557984 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:07:57.578492 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_api:SELECT=14 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:07:57.582173 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-54c886c6-5f4c-45ba-9060-2a4bcb0a003f admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.589336 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-54c886c6-5f4c-45ba-9060-2a4bcb0a003f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012233 Oct 06 08:07:57.589858 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:07:57.601024 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-7b4147f8-7799-42b1-ab6c-ec45eba03e5a admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.609332 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-7b4147f8-7799-42b1-ab6c-ec45eba03e5a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011856 Oct 06 08:07:57.609844 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:07:57.621972 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.629550 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011884 Oct 06 08:07:57.630241 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:07:57.641390 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-1399bf3f-ee0c-4cc7-adbe-8bc7b36e9803 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:07:57.648532 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-1399bf3f-ee0c-4cc7-adbe-8bc7b36e9803 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010705 Oct 06 08:07:57.649090 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Thu Oct 6 08:07:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:11:26.654886 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:26.655917 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 06 08:11:26.656309 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:11:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:11:26.795544 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=6 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:11:26.938805 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:26.943447 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:26.943914 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:26.944332 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:26.945043 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:26.945484 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:26.946459 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:26.977296 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-fb5440be-f7a0-40a2-b5fe-83e9a735acf2 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.182824 Oct 06 08:11:26.977850 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:11:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:11:28.060352 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:28.061362 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 06 08:11:28.061759 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:11:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:11:28.251913 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:28.255606 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:28.256084 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:28.256510 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:28.257224 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:28.257674 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:28.258130 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:28.277247 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-3309631c-f380-4de8-9014-8ee515e8601d admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076772 Oct 06 08:11:28.277726 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:11:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:11:39.805306 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:39.806328 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Oct 06 08:11:39.806726 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:11:39.950874 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_cell0:SELECT=4 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:11:39.951642 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_cell1:SELECT=4 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:11:39.952233 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG dbcounter [-] [106016] Writing DB stats nova_api:SELECT=8 {{(pid=106016) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:11:39.999936 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:40.003575 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:40.004293 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:40.004714 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:40.005447 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:40.005885 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:40.006294 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:40.032631 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-7ad99794-1cdd-4642-9293-7abb561d90f0 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086016 Oct 06 08:11:40.033107 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:11:39 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:11:41.135319 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG nova.api.openstack.wsgi [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] Calling method '>' {{(pid=106017) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:41.136372 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: INFO nova.api.openstack.requestlog [None req-9f720cfd-9ca6-4c64-900f-3a038822a092 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 06 08:11:41.136763 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: [pid: 106017|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Thu Oct 6 08:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:11:41.326334 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG nova.api.openstack.wsgi [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Calling method '>' {{(pid=106016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:11:41.329749 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:41.330223 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:41.330644 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:41.331389 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:11:41.331842 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:11:41.332249 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: DEBUG oslo_concurrency.lockutils [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:11:41.353507 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: INFO nova.api.openstack.requestlog [None req-a640ae0e-f8dd-47fe-9cba-9405743288ad admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.078367 Oct 06 08:11:41.353985 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: [pid: 106016|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Thu Oct 6 08:11:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:12:38.497128 dv-cinder-860212-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 06 08:12:38.497897 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: Thu Oct 6 08:12:38 2022 - graceful shutdown triggered... Oct 06 08:12:38.498366 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: Gracefully killing worker 2 (pid: 106017)... Oct 06 08:12:38.499670 dv-cinder-860212-3-iscsi devstack@n-api.service[106016]: Gracefully killing worker 1 (pid: 106016)... Oct 06 08:12:38.628343 dv-cinder-860212-3-iscsi devstack@n-api.service[106017]: DEBUG dbcounter [-] [106017] Writing DB stats nova_api:SELECT=4 {{(pid=106017) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:12:39.499061 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: worker 1 buried after 1 seconds Oct 06 08:12:39.499588 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: worker 2 buried after 1 seconds Oct 06 08:12:39.499588 dv-cinder-860212-3-iscsi devstack@n-api.service[106015]: goodbye to uWSGI. Oct 06 08:12:39.500597 dv-cinder-860212-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 06 08:12:39.501141 dv-cinder-860212-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 06 08:12:39.504223 dv-cinder-860212-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 06 08:12:39.515914 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 6 08:12:39 2022] *** Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: nodename: dv-cinder-860212-3-iscsi Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: machine: x86_64 Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: clock source: unix Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: pcre jit disabled Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: detected number of CPU cores: 4 Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: current working directory: / Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: detected binary path: /usr/bin/uwsgi-core Oct 06 08:12:39.517897 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: your processes number limit is 47680 Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: your memory page size is 4096 bytes Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: detected max file descriptor number: 2048 Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: lock engine: pthread robust mutexes Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: thunder lock: enabled Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 06 08:12:39.518700 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 06 08:12:39.563462 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: Python main interpreter initialized at 0x5615ea2579c0 Oct 06 08:12:39.563750 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: python threads support enabled Oct 06 08:12:39.563915 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: your server socket listen backlog is limited to 100 connections Oct 06 08:12:39.564113 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: your mercy for graceful operations on workers is 90 seconds Oct 06 08:12:39.564739 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: mapped 403077 bytes (393 KB) for 2 cores Oct 06 08:12:39.565076 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: *** Operational MODE: preforking *** Oct 06 08:12:39.565742 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: *** uWSGI is running in multiple interpreter mode *** Oct 06 08:12:39.565911 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: spawned uWSGI master process (pid: 121064) Oct 06 08:12:39.566297 dv-cinder-860212-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 06 08:12:39.568577 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: spawned uWSGI worker 1 (pid: 121076, cores: 1) Oct 06 08:12:39.568577 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: spawned uWSGI worker 2 (pid: 121077, cores: 1) Oct 06 08:12:39.568776 dv-cinder-860212-3-iscsi devstack@n-api.service[121064]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 06 08:12:40.235206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 08:12:40.239741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 06 08:12:41.425776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:12:41.425776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: from cryptography.utils import int_from_bytes Oct 06 08:12:41.426481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:12:41.426481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: from cryptography.utils import int_from_bytes Oct 06 08:12:41.429441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:12:41.429441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: from cryptography.utils import int_from_bytes Oct 06 08:12:41.429933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 06 08:12:41.429933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: from cryptography.utils import int_from_bytes Oct 06 08:12:43.879773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 08:12:43.880385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 08:12:43.880621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 08:12:43.880878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 08:12:43.881136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 08:12:43.881534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.881869 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.882197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.882522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.882859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.883201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.883530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.883852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.884182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.884449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.884769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.885274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-3-iscsi {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.885605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.885923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.886243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.886575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.886888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.887246 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.887573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.888087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.890313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.890313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.890313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.890610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.890843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.891154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.891486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.891815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.892316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.892531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.892864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-3-iscsi {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.893169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.893483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.893802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.894252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.894566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.894866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.895220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.895556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.895882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.896216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.896506 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.896832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.897153 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.897459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.897771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.898083 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.898405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.898717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.899055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.899340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.899623 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.899947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.900269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.900597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.900854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.901116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.901469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.901767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.902084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.902395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.902702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.903041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.903354 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.903667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.903667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.904913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.905317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.905641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.905974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.906285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.906613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.907057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.907314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.907627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.907975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.908300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.908612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.908934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.909279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.909571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.909882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.910199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.910509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.910850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.911183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.911438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.911743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.912051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.912372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.912682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.912993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.913302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.913606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.913914 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.914220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.914529 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.914840 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.915067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 06 08:12:43.915601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.915749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 06 08:12:43.915918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.915918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.916201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 06 08:12:43.916348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.916494 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 06 08:12:43.916648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.916789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 06 08:12:43.916956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.917122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.917262 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.917407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.917638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.918517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.918692 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.918847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.919031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.919190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.919343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.919490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.919850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920037 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.920919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921529 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860212-3-iscsi {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.921956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.922888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.923933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924426 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.924911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925585 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.925906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.926962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.927114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.927270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.927410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.927548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.927795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.928245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860212-3-iscsi {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.928411 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.928657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.928805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.928955 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.929103 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.929263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.929413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.929559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.929707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.929861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.930036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.930181 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.930339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.930481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.930620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.930801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.930984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.931160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.931314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.931461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.931607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.931764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.932014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.932177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.932326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.932473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.932618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.932765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.932905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.933071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.933211 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.933357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.933584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.933752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.933908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.934093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.934247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.934395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.934395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.934670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.935515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.936556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.937272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.937441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.937587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.937782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.938053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.938601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.938886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.939081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.939233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.939376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.939534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.939687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.939840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.940017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.940162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.940162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.940434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.940665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.940817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.940958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.941097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.941244 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.941384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.941543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.941690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.941850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.942009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.942261 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.942407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.942563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.942717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.942859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.943019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.943165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.943314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.943478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.943619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.943796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.943944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.944089 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.944242 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.944383 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.944530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.944677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.944817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.944964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.945115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.945264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.945414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.945560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.945708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.945858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.946007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.946147 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.946333 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.946481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.946629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.946809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.947001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.947150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.947299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.947458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.947605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.947804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.947962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.948138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.948283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.948679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.948835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.949101 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.949272 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.949541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.949680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.949826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.949984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.950135 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.950283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.950423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.950423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.950697 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.950839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.950991 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.951901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.952007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.952289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.952390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.952481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.952574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.952660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.952750 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.952840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.952930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.953022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.953106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.953195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.953294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.953463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.953559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.953643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.953808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.953907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.953992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.954081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.954166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.954273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.954367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.954459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.954549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.954639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.954728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.954824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.954917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955544 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.955997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.955997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.956313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.956417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.956504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.956504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.956673 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.956757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.956854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.956938 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.957020 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.957108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.957197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.957280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.957370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.957462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.957551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.957640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.957729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.957819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.958031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.958126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.958217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.958302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.958384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.958473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.958604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.959465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.959566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.959653 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.959753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.959897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.959989 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.960162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.960335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.960525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.960691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.960854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.960944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.961035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 06 08:12:43.961209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.961922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.962983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963441 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.963995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964755 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.964866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965497 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965714 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.965814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.966043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.966176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.966353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.966461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.966694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.967451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.967671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.967774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.968876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.969805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970349 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970664 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.970761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.971969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.972946 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.973930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.974919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.975907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.976092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.976218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.976535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.976842 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.977016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.977228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.977554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.977706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.977858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.978879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.979963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.980982 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.981855 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.982835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.983116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.983260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.983343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.983565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.983657 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.984827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985137 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.985864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986720 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.986820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.987795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988735 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.988943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989557 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.989951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.990866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.991089 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.991196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.991393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.991490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.991716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992425 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.992936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993369 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.993933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.994906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995020 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.995960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996265 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.996879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.997811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.998051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.998150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.998376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.998575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.998731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:43.999948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.000925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.001961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.002899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.003131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.003231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.003442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.003542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.004973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005689 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.005911 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006533 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.006849 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.007892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.008825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.009961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010064 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.010880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011065 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011825 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.011924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.012859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.013075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.013166 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.013390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.013488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.014246 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.014400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.014668 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.014767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.015953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016242 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016383 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016865 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.016968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.017942 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.018906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.019803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.020932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.021864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022569 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.022863 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023211 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.023998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024430 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.024970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.025956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.026889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.027953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.028864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.029076 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.029191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.029939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.030866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.031865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.032822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.033944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034572 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.034906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035008 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.035978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.036898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.037892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038523 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.038997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.039980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040226 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.040947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041250 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.041875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.042793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043033 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.043970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.044963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045359 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.045934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046762 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.046854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.047861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.048810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049016 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049727 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.049940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.050987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051196 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.051986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052437 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.052978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053383 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.053927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.054890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.055951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056174 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056484 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.056883 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.057872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.058765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059101 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.059958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.060049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.060270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.060965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.061964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.062910 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063184 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063275 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.063947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.064879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065416 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.065814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.066995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.067918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068873 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.068976 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.069205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.069296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.069520 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.069619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.069830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.070916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.071884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.072860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.073801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.074952 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.075048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.075276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.075380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.075599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.075698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.076000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.076676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.076845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.077899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078227 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.078887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079547 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.079953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080830 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.080933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.081886 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.082846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083129 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.083866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084508 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.084831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.085971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.086910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087033 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.087976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088595 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.088947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.089139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.089342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.089460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.089661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.089794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.090997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.091940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092728 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.092979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.093905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094547 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.094871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.095085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.095211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.095431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.095801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.095948 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.096062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.096713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.096830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.096935 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.096935 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097538 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.097917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098062 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098367 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098673 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.098771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.099806 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.100969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.101909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.102859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.103086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.103179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107911 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.107984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108441 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.108882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.109932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110293 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.110886 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.111902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.112849 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113369 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113608 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.113960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.114884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115828 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.115922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.116864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.117800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.118865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.119004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.119731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.119861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.119951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120501 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.120942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121234 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.121871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122016 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.122841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.123828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.124761 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125589 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.125904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126325 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.126924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.127975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.128184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.128275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.128497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.128850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129065 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.129765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.130902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131229 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.131949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132778 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.132967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133275 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.133889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.134920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.138701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.138850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.139055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.139148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.139236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.139756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.139938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140849 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.140967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141319 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.141990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142444 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142686 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.142803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.143913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.144869 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145655 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.145925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.146855 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.147017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.147540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.147666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.147787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.147900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148181 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.148786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149493 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149606 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.149966 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150198 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150320 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.150994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151519 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.151875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121077) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.152555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.153423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.153423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.153423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.153794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.153927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.155468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.155468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.155686 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.155835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.156168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.156498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.156802 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.157108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.157415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.157729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.158050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.158362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.158670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.158988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.159302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.159611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.159918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.160224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.160529 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.160843 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.161146 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.161450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.161753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.162058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.162360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.162718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.163001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.163296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.163599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.167363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.168961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.169282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.169594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.170475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.170782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.171142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.171474 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.171785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.172116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.172477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.172796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.173115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.173430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.173761 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.174074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.174388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.174700 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.175035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.175351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.175669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.176021 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.176304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.176607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.176923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.177251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.177688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.178008 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.178340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.178670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.179051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.179369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.179714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.180047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.180365 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.180678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.180989 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 06 08:12:44.181234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121076) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 06 08:12:44.213600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO dbcounter [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Registered counter for database nova_api Oct 06 08:12:44.235210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.241964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writer thread running {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.244382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO dbcounter [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Registered counter for database nova_api Oct 06 08:12:44.264598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_db.sqlalchemy.engines [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.271407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writer thread running {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.298795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.context [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19a0419b-ae97-4662-abef-e84eaae985c7(cell1) {{(pid=121077) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 08:12:44.302836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:12:44.303345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:12:44.304940 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:12:44.305683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:12:44.306137 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:12:44.308181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:12:44.310185 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO dbcounter [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Registered counter for database nova_cell0 Oct 06 08:12:44.314846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO dbcounter [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Registered counter for database nova_cell1 Oct 06 08:12:44.322544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.324303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.328990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.context [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),19a0419b-ae97-4662-abef-e84eaae985c7(cell1) {{(pid=121076) load_cells /opt/stack/nova/nova/context.py:464}} Oct 06 08:12:44.330643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writer thread running {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.333041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:12:44.333311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writer thread running {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.333517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:12:44.335130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:12:44.335866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:12:44.336317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:12:44.338311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:12:44.340339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO dbcounter [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Registered counter for database nova_cell0 Oct 06 08:12:44.344417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO dbcounter [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Registered counter for database nova_cell1 Oct 06 08:12:44.351688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_db.sqlalchemy.engines [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.353468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_db.sqlalchemy.engines [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.359140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writer thread running {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.364372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writer thread running {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.481487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO dbcounter [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Registered counter for database nova_cell0 Oct 06 08:12:44.490592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_db.sqlalchemy.engines [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121077) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.495118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writer thread running {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.511992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO dbcounter [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Registered counter for database nova_cell0 Oct 06 08:12:44.520021 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_db.sqlalchemy.engines [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121076) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 06 08:12:44.524454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writer thread running {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 06 08:12:44.821170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: WARNING keystonemiddleware.auth_token [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:12:44.828555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: WARNING keystonemiddleware.auth_token [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:12:44.851277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: WARNING keystonemiddleware.auth_token [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:12:44.859856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: WARNING keystonemiddleware.auth_token [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:12:45.179306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: WARNING keystonemiddleware.auth_token [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:12:45.185332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: WARNING keystonemiddleware.auth_token [None req-0ca68895-445c-4348-b2a0-41bdc43777fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:12:45.191201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615ea2579c0 pid: 121077 (default app) Oct 06 08:12:45.215764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: WARNING keystonemiddleware.auth_token [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 06 08:12:45.221883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: WARNING keystonemiddleware.auth_token [None req-57f1a98f-9c5c-4ff1-8908-5d169e2794c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 06 08:12:45.227168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5615ea2579c0 pid: 121076 (default app) Oct 06 08:13:21.362508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:21.363359 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:21.364113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:21.364937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:22.542050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-106b38c3-ce46-416d-8324-a4b670cab103 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Action: 'create', calling method: .version_select at 0x7f923cbb5550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-102032534", "metadata": {"Type": "work"}}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:24.513491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-106b38c3-ce46-416d-8324-a4b670cab103 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.162382 Oct 06 08:13:24.513491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Oct 6 08:13:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3165 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 08:13:24.527439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:24.529549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:24.529549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:24.530681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:24.999448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-aae3909f-af24-4d79-89ea-7bcb973d60b6 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923cc030d0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:25.223669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-aae3909f-af24-4d79-89ea-7bcb973d60b6 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 352 microversion: 2.1 time: 0.701464 Oct 06 08:13:25.224722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:24 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 352 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:26.238451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1d5f73bf-6201-4464-8595-e4d2af50776f tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923ca89430>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:26.360782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1d5f73bf-6201-4464-8595-e4d2af50776f tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 352 microversion: 2.1 time: 0.126670 Oct 06 08:13:26.361500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:26 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:26.713148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a3503975-4ecc-41fd-88e9-cd3cfaf8f470 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923cacb550>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:26.784931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a3503975-4ecc-41fd-88e9-cd3cfaf8f470 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/d480abf2-76a4-4998-a325-ceb88665f168" status: 200 len: 351 microversion: 2.1 time: 0.077754 Oct 06 08:13:26.793867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:26 2022] GET /compute/v2.1/os-volumes/d480abf2-76a4-4998-a325-ceb88665f168 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:27.381284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-252aafe9-233c-44eb-8e0c-2498dcddf584 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923ca89af0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:27.711819 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-252aafe9-233c-44eb-8e0c-2498dcddf584 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 353 microversion: 2.1 time: 0.339278 Oct 06 08:13:27.712955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:27 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 353 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:27.744249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a4846177-70eb-4a8a-9678-edde9ce8c4d1 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923cacbaf0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:27.878249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a4846177-70eb-4a8a-9678-edde9ce8c4d1 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 353 microversion: 2.1 time: 0.154326 Oct 06 08:13:27.879872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:27 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:27.898019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3191873a-9ac7-4881-b8d4-5caf6c4b7587 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923ca231f0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:28.197577 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3191873a-9ac7-4881-b8d4-5caf6c4b7587 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 202 len: 0 microversion: 2.1 time: 0.303503 Oct 06 08:13:28.198620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:13:27 2022] DELETE /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:13:28.207922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-92858bb1-692c-460c-bf2e-4ac1b368b72b tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923cacbca0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:28.295726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-92858bb1-692c-460c-bf2e-4ac1b368b72b tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 352 microversion: 2.1 time: 0.092872 Oct 06 08:13:28.303162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:28 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:29.310065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0446380-34db-4e21-891e-b3e580ed68f7 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923ca89c10>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:29.457964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e0446380-34db-4e21-891e-b3e580ed68f7 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 200 len: 352 microversion: 2.1 time: 0.151574 Oct 06 08:13:29.458529 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:29 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:30.034866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-56409158-57b7-4e31-9a0b-b9da16843a43 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923cacb550>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:30.155116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-56409158-57b7-4e31-9a0b-b9da16843a43 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/de417bda-e207-4e33-9fe9-a428dd631878" status: 200 len: 350 microversion: 2.1 time: 0.117079 Oct 06 08:13:30.157201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:30 2022] GET /compute/v2.1/os-volumes/de417bda-e207-4e33-9fe9-a428dd631878 => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:30.480995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6902ca7-e40b-43d2-a2e3-30f5073ab382 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Calling method '.version_select at 0x7f923ca89550>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:31.254879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-b6902ca7-e40b-43d2-a2e3-30f5073ab382 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] HTTP exception thrown: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6902ca7-e40b-43d2-a2e3-30f5073ab382 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Request method failure captured: Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 HTTP/1.1 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4hwtSGAK2-4pA_PROY_fqkAnk7Zfc7fZ_itPwtyEXj1eq775aW_2gnwTd-QuvrS5cg8_S6oFPParAZPFq1_kXDoFLTITs68pvzkCXDdw-m7CmLH3RVCCCOrp5AsSqfgd-5Avdkf3V-WwDd7TTIhzg9HjrC9GnoS0BmIvWA6Ep3Dmo Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 546cd66807054a5a8d7a8137e90a4f36 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesGetTestJSON-2129284383 Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:13:31.260360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_546cd66807054a5a8d7a8137e90a4f36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/546cd66807054a5a8d7a8137e90a4f36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/546cd66807054a5a8d7a8137e90a4f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/546cd66807054a5a8d7a8137e90a4f36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesGetTestJSON-2129284383 Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 546cd66807054a5a8d7a8137e90a4f36 Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesGetTestJSON-2129284383 Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesGetTestJSON-2129284383-project Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 3907dcef06814ce7a1434d9c451c1980 Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesGetTestJSON-2129284383-project Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'c38a8dc5-2ab1-43b1-9230-4ad1c69098b6'} Oct 06 08:13:31.262912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. (HTTP 404) (Request-ID: req-45867b7f-8190-4185-98ce-f9fecd8ad50e) Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:13:31.265672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:13:31.266567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 08:13:31.267454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:13:31.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6902ca7-e40b-43d2-a2e3-30f5073ab382 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] Returning 404 to user: Volume c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:13:31.270541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b6902ca7-e40b-43d2-a2e3-30f5073ab382 tempest-VolumesGetTestJSON-2129284383 tempest-VolumesGetTestJSON-2129284383-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6" status: 404 len: 109 microversion: 2.1 time: 0.796782 Oct 06 08:13:31.273714 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:30 2022] GET /compute/v2.1/os-volumes/c38a8dc5-2ab1-43b1-9230-4ad1c69098b6 => generated 109 bytes in 806 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:13:38.092148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1902927697", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "networks": [{"uuid": "d4b48675-97a8-455a-80c1-1dbdd2aa13b8"}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:38.348339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] validate_networks() for [('d4b48675-97a8-455a-80c1-1dbdd2aa13b8', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:38.441244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8b966a38-9453-41e9-b53d-d8096fcb51ae tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: .version_select at 0x7f923ca239d0>, body: {"keypair": {"name": "tempest-keypair-1428677554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmP2p960LZl479xKu8JEh6i/NcS57pF1vDFmRpKGM5IaMQh/SoF16yDslOesdZN8bfjYynhCXl+HNx8pKP/0WhH0VXURlhOiCEeGKcU1WXo8ml4RdrWmcRX5kQTXvZUPw=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:38.543567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-8b966a38-9453-41e9-b53d-d8096fcb51ae tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:38.554113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-8b966a38-9453-41e9-b53d-d8096fcb51ae tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for user 36b26040882a4e85b82b40a3c17d33bb and project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:38.700796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8b966a38-9453-41e9-b53d-d8096fcb51ae tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.860516 Oct 06 08:13:38.711131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 7/12] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Oct 6 08:13:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 871 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 06 08:13:38.866733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-71a6d459-5da0-4f33-b579-82ead699f742 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: .version_select at 0x7f923c9619d0>, body: {"keypair": {"name": "tempest-keypair-141205780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzPPDFYxPKfrLhA0DqtaHwnfwJ8SGm2zx6I3f8g+fJYVscde/h/orpOA2tbNWlxIu4oBdLIDmrhOmpoI4lr5XVsngJs06YfcuvV8xEoLyy0gBB0XOukn4/4/Kw9oZloIw=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:38.913201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-71a6d459-5da0-4f33-b579-82ead699f742 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for project 73f960dc36054e9ba7003628a82b7039. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:38.940674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-71a6d459-5da0-4f33-b579-82ead699f742 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for user cb73bbd331754280a2a0cd64290ec3c8 and project 73f960dc36054e9ba7003628a82b7039. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:39.189276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-71a6d459-5da0-4f33-b579-82ead699f742 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.476651 Oct 06 08:13:39.189884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 8/13] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:13:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:39.199271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cfd8a24d-046a-4d98-ba8a-1bbd0abf4231 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c998d30>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:39.313897 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cfd8a24d-046a-4d98-ba8a-1bbd0abf4231 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e60f3ba0-674d-4e9c-9c04-ba0a54ce1fe8" status: 200 len: 351 microversion: 2.1 time: 0.122967 Oct 06 08:13:39.315044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 9/14] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:13:39 2022] GET /compute/v2.1/os-volumes/e60f3ba0-674d-4e9c-9c04-ba0a54ce1fe8 => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:39.329588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b66dcf6b-f8e0-4332-940b-cfbf2c265fef tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c996310>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:39.499885 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b66dcf6b-f8e0-4332-940b-cfbf2c265fef tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.174039 Oct 06 08:13:39.515338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 10/15] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Oct 6 08:13:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:39.524949 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6adfd22d-614f-4972-b163-2b4f313569e7 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c998040>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:39.785403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6adfd22d-614f-4972-b163-2b4f313569e7 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.268766 Oct 06 08:13:39.786754 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 11/16] 10.222.0.30 () {58 vars in 1149 bytes} [Thu Oct 6 08:13:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:39.815223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-22ed4634-67ff-4b5a-8d96-7f4c65c685aa tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c9619d0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:40.245172 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-22ed4634-67ff-4b5a-8d96-7f4c65c685aa tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.444866 Oct 06 08:13:40.246457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 12/17] 10.222.0.30 () {58 vars in 1134 bytes} [Thu Oct 6 08:13:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:40.278535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dd1d9b36-58d8-49fb-8915-701ed3a86665 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c996af0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:40.437271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:40.437746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:40.438539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:40.438772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:40.439578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:40.477333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:40.480289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:40.486001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:40.494933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-dd1d9b36-58d8-49fb-8915-701ed3a86665 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.234267 Oct 06 08:13:40.497147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 13/18] 10.222.0.30 () {58 vars in 1167 bytes} [Thu Oct 6 08:13:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:40.501790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:40.505281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:40.506749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:40.511348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2632a57a-1784-48e8-a6ed-98f65c7f66e8 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c997820>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:40.608563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Getting quotas for project 37c1a79616054d3c988fac816f4acc8b. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:40.628009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Getting quotas for user 9427fe8723fb4b298b42106a862a798f and project 37c1a79616054d3c988fac816f4acc8b. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:40.680941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:40.690225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:40.748686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2632a57a-1784-48e8-a6ed-98f65c7f66e8 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.241347 Oct 06 08:13:40.761786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 14/19] 10.222.0.30 () {58 vars in 1170 bytes} [Thu Oct 6 08:13:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:40.766638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2464f203-74a5-43dc-a81e-a9e000827ced tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c92d1f0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:40.927285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-26d50549-4cff-443c-be55-5f3d5149db38 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.185309 Oct 06 08:13:40.930238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 6/20] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:13:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:13:40.942290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5a4f28a4-0add-41a4-8939-45a056b5c840 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:40.943703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5a4f28a4-0add-41a4-8939-45a056b5c840 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:41.224328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2464f203-74a5-43dc-a81e-a9e000827ced tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.461341 Oct 06 08:13:41.225041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 15/21] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Oct 6 08:13:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:41.243745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e4f39d7f-4a8a-4c4a-9665-1fb3564272d5 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c997b80>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:41.254752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5a4f28a4-0add-41a4-8939-45a056b5c840 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:41.308814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5a4f28a4-0add-41a4-8939-45a056b5c840 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1215 microversion: 2.1 time: 0.371247 Oct 06 08:13:41.324171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 7/22] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:40 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1215 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:41.663680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e4f39d7f-4a8a-4c4a-9665-1fb3564272d5 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.423753 Oct 06 08:13:41.664365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 16/23] 10.222.0.30 () {58 vars in 1188 bytes} [Thu Oct 6 08:13:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:41.681164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-59841f30-e31a-46e2-892a-35387f57b981 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] Calling method '.version_select at 0x7f923c144820>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:42.037771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-59841f30-e31a-46e2-892a-35387f57b981 tempest-VolumesTestJSON-830972471 tempest-VolumesTestJSON-830972471-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.361039 Oct 06 08:13:42.038362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 8/24] 10.222.0.30 () {58 vars in 1155 bytes} [Thu Oct 6 08:13:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:42.335258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f032fa0-58ae-4218-bdc4-492fb1428349 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:42.338497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7f032fa0-58ae-4218-bdc4-492fb1428349 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:42.709847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7f032fa0-58ae-4218-bdc4-492fb1428349 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:42.759566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7f032fa0-58ae-4218-bdc4-492fb1428349 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1215 microversion: 2.1 time: 0.427324 Oct 06 08:13:42.763584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 17/25] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:42 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1215 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:43.788647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d8206f47-6616-4383-b8b8-8396cea11a29 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:43.789330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d8206f47-6616-4383-b8b8-8396cea11a29 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:44.236370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d8206f47-6616-4383-b8b8-8396cea11a29 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:44.244623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d8206f47-6616-4383-b8b8-8396cea11a29 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1215 microversion: 2.1 time: 0.460133 Oct 06 08:13:44.267078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 9/26] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:43 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1215 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:45.351191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fc62e644-788f-494c-a093-7f0898a8d666 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: .version_select at 0x7f923c997550>, body: {"keypair": {"name": "tempest-keypair-327080643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpWP+pOQtu2E7dQOB+9IKgXzvILvoXS/sqkMo5QCfYpHnIBa66Urs62viqKQwY2C0io3cZYnuOkjBASNQ6yphYCP1HZZNo6b3dZXtmCCiM9mk9OCFArT2YASputvON4SA=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:45.456523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-987559835", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:45.483112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-fc62e644-788f-494c-a093-7f0898a8d666 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:45.508764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-fc62e644-788f-494c-a093-7f0898a8d666 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:45.636280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] validate_networks() for [('07f9b034-ef59-4413-807d-584389e10697', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:45.717654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fc62e644-788f-494c-a093-7f0898a8d666 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.718627 Oct 06 08:13:45.718499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 18/27] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:13:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:13:45.727718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:45.730327 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:45.748415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:45.750672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:45.751165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:45.751904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:45.752370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:45.752803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:46.120937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:46.138308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f4047490-8d74-47a9-9bc0-14f60fc2ab6a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1267 microversion: 2.1 time: 0.418306 Oct 06 08:13:46.139363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 19/28] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:45 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:46.152076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1478763145", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196136f6-8e40-440d-a011-583cca4d460b"}], "security_groups": [{"name": "tempest-securitygroup--1914165952"}], "key_name": "tempest-keypair-1428677554", "user_data": "}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:46.799396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] validate_networks() for [('196136f6-8e40-440d-a011-583cca4d460b', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:46.893206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:46.894250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:46.896936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:46.897874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:46.898522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:46.929833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:46.932925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:46.934598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:46.935699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:46.949277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:46.949277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:47.029542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:47.052524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for user 85bdfc4b6ad443d68ebc0d6932ccad66 and project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:47.095685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:47.098232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:47.313215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b958b9f-5ce9-446f-863c-9d5647e92c88 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.216916 Oct 06 08:13:47.318792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 10/29] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:13:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:13:47.330966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:47.334008 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:47.366558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:47.368617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:47.371014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:47.392084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:47.394779 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:47.402025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:47.749440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:47.807803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-09398ccc-9312-434a-8015-a25627ae0ddb tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1273 microversion: 2.1 time: 0.486986 Oct 06 08:13:47.826614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 11/30] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:47 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1273 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:47.841075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-695f7108-1322-4a2f-ae41-f5f4479783f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:47.843319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-695f7108-1322-4a2f-ae41-f5f4479783f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:47.993670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-695f7108-1322-4a2f-ae41-f5f4479783f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:48.014465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-695f7108-1322-4a2f-ae41-f5f4479783f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1221 microversion: 2.1 time: 0.186235 Oct 06 08:13:48.015719 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 12/31] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:47 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1221 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:48.021829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1073889579", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18fda9e7-3500-4ee8-bef0-caac3b366832"}], "security_groups": [{"name": "tempest-securitygroup--552048120"}], "key_name": "tempest-keypair-141205780", "user_data": "}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:48.395502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] validate_networks() for [('18fda9e7-3500-4ee8-bef0-caac3b366832', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:50.213389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:50.214173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:50.214290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:50.214685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:50.215131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:50.233622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:50.234544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:50.235361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:50.236362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:50.237205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:50.238732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:50.440269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:50.440269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for user 36b26040882a4e85b82b40a3c17d33bb and project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:50.440269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:50.441117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:50.441587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:50.441587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:50.441587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:50.441587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:50.441587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:50.442613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:50.442613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:50.442613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:50.442613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:50.443183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:50.443183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:50.443183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for project 73f960dc36054e9ba7003628a82b7039. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:50.443183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for user cb73bbd331754280a2a0cd64290ec3c8 and project 73f960dc36054e9ba7003628a82b7039. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:50.443459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:50.443459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:51.011359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-462b5ca1-b514-4dea-b989-6bcf22ac489b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.990100 Oct 06 08:13:51.011359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 13/32] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:13:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 2993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:13:51.019928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-189257556", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:51.061197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f861134b-d8c0-490b-aad5-c260e4475f19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.920609 Oct 06 08:13:51.073945 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 20/33] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Oct 6 08:13:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 4934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 08:13:51.102411 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:51.108551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:51.132326 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] validate_networks() for [('07f9b034-ef59-4413-807d-584389e10697', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:51.138192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:51.153434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:51.154017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:51.157477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:51.157603 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:51.157972 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:51.559201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:51.572717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4bcd31d1-c7bd-40e7-b21f-b64a2c03c544 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.494087 Oct 06 08:13:51.573294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 21/34] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:51 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:51.579145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-032f235d-9605-4d12-81b6-ec70bb0bfc5f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:51.580099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-032f235d-9605-4d12-81b6-ec70bb0bfc5f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:51.676884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-032f235d-9605-4d12-81b6-ec70bb0bfc5f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:51.690953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-032f235d-9605-4d12-81b6-ec70bb0bfc5f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1237 microversion: 2.1 time: 0.114288 Oct 06 08:13:51.690953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 22/35] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:51 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1237 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:51.699069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:51.700531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:51.819668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:51.831251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:51.832848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:51.834540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-356caa06-c213-4b50-8549-18e8345e7635 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1282 microversion: 2.20 time: 0.142015 Oct 06 08:13:51.835706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 23/36] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:51 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:13:51.985999 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:51.987116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:51.988247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:51.989505 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:51.990291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:52.007157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:52.007840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:52.009340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:52.010468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:52.011202 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:52.011837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:52.052482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:52.059116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for user 85bdfc4b6ad443d68ebc0d6932ccad66 and project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:52.085348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:52.090277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:52.335233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a31ba9e-c514-48c2-82eb-659e3d02bac1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.324700 Oct 06 08:13:52.342578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 14/37] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:13:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1332 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:13:52.356128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2d4c2bf2-4242-44a2-98fd-977be99a7bac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:52.357080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2d4c2bf2-4242-44a2-98fd-977be99a7bac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:52.444107 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1222549998", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916cf03d-8c1b-4b3b-a1cf-702059cc42e1"}], "security_groups": [{"name": "tempest-securitygroup--1832640660"}], "key_name": "tempest-keypair-327080643", "user_data": "}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:52.525109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2d4c2bf2-4242-44a2-98fd-977be99a7bac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:52.537931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2d4c2bf2-4242-44a2-98fd-977be99a7bac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1221 microversion: 2.1 time: 0.188050 Oct 06 08:13:52.543086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 24/38] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:52 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:52.600752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:52.611753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:52.615811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:52.621056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:52.621610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:52.622468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:52.625235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:52.626664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:52.714619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] validate_networks() for [('916cf03d-8c1b-4b3b-a1cf-702059cc42e1', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:13:53.283874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:53.359135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e2f8c924-328a-492e-8a66-9fe0c145160b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.757072 Oct 06 08:13:53.360468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 25/39] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:52 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:53.380304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:53.382606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:53.423034 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:53.427538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:53.431476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:53.434505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:53.438008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:53.442917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:53.714527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:53.752062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f00b7fa0-de5f-42a9-a36a-1aecefa79f10 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1241 microversion: 2.1 time: 0.385696 Oct 06 08:13:53.753239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 26/40] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:53 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1241 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:53.763582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:53.765382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:53.789127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:53.793096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:53.793553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:53.800558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:53.801068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:53.807744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:54.037213 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:54.061280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:54.067755 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:54.070971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4cf1d17d-6011-4f1d-b0c4-c76bc938b353 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1278 microversion: 2.20 time: 0.314908 Oct 06 08:13:54.084620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 27/41] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:53 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:13:54.106073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9b6155b3-e517-4a51-bbd3-5715141b71cb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:54.108364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9b6155b3-e517-4a51-bbd3-5715141b71cb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:54.270524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:13:54.270524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:13:54.270524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:13:54.270524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:13:54.270524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:13:54.273596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:54.273596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:54.273596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:54.273596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:54.274490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:54.274490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:54.274490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:13:54.278318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:13:54.313527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:13:54.320615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:13:54.349618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9b6155b3-e517-4a51-bbd3-5715141b71cb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:54.367086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9b6155b3-e517-4a51-bbd3-5715141b71cb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1221 microversion: 2.1 time: 0.269297 Oct 06 08:13:54.367626 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 28/42] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:54 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:54.386403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:54.387133 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:54.394964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:54.395727 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:54.396286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:54.397116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:54.397579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:54.398006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:54.534701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1a287000-d2f7-4aab-8c9f-33036a04d80b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.095164 Oct 06 08:13:54.544977 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 15/43] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:13:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:13:54.574377 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-84d6792b-2acb-4978-910b-8a2560aefccd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:54.575502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-84d6792b-2acb-4978-910b-8a2560aefccd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:54.580241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:55.187597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-84d6792b-2acb-4978-910b-8a2560aefccd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.212312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-84d6792b-2acb-4978-910b-8a2560aefccd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1241 microversion: 2.1 time: 0.654679 Oct 06 08:13:55.215417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 16/44] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:54 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1241 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:13:55.236983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:55.237467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:55.302914 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.309534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.314217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.319069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.319720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.328401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.426732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.440636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a4c51c69-9ab9-41d6-8e45-91234815ac18 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 1.058955 Oct 06 08:13:55.457105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 29/45] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:54 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:55.474017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:55.475394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:55.485025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.485981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.486748 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.487694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.488372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.489274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.686511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.698381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-71fdc852-43ec-41bb-a484-c81caf219b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1289 microversion: 2.1 time: 0.478713 Oct 06 08:13:55.701291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 17/46] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:55 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1289 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:55.708659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:55.745762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:55.784213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.786526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.787164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.790823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:55.790823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:55.791849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:55.926801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.940526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.955182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:55.958017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-08799002-366e-4f12-a18b-1319ab23987b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1278 microversion: 2.20 time: 0.498622 Oct 06 08:13:55.962078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 30/47] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:55 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1278 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:13:56.005178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:56.029602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6d9e3b5a-4aa7-4b2d-bb71-d0d0a899c687 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1217 microversion: 2.1 time: 0.325147 Oct 06 08:13:56.030308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 18/48] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:55 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1217 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:56.248624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-870fd659-ebad-4fd4-acfd-0b9532f5cf6b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:56.249544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-870fd659-ebad-4fd4-acfd-0b9532f5cf6b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:56.478785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:56.480545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:56.495018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-870fd659-ebad-4fd4-acfd-0b9532f5cf6b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:56.511023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-870fd659-ebad-4fd4-acfd-0b9532f5cf6b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1241 microversion: 2.1 time: 0.262802 Oct 06 08:13:56.524121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 31/49] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:56 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1241 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:56.524627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:56.524627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:56.524627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:56.559608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:56.560109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:56.563744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:56.739685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:56.742790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:56.771069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:56.775928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:56.775928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:56.776889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:56.777524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:56.778115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.054627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.063546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4b7758ae-5bb4-4288-9a2e-7a9d04db8412 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1297 microversion: 2.1 time: 0.330488 Oct 06 08:13:57.068881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 32/50] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:56 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1297 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:57.081775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:57.082407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:57.115382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.117303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.118011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.119582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.120912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.122270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.261394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.273466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ddc34c39-5129-45e2-bfb0-d0d74edb0783 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.800374 Oct 06 08:13:57.277358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 19/51] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:56 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:57.286913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:57.287801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:57.300308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.303238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.303976 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.305597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.309376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.310173 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.330459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.351961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.353652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.358499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e572dd4c-7058-44fe-8d90-70217efc1572 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1334 microversion: 2.20 time: 0.285413 Oct 06 08:13:57.359669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 33/52] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:57 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1334 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:13:57.476850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:57.492399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7169e4d0-9a6e-4f6e-8304-63dbe5b08baa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1217 microversion: 2.1 time: 0.210167 Oct 06 08:13:57.495572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 20/53] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:57 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:57.539487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:57.540047 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:57.561184 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.561753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.562296 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:57.563129 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:57.563881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:57.564184 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.086669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:58.099120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6fda2b25-39fa-4b66-b84e-59046686552f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1237 microversion: 2.1 time: 0.563991 Oct 06 08:13:58.102125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 34/54] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:57 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1237 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:58.128024 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:58.129513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:58.165580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:13:58.176542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.178669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.182130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.184360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.185108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.185548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.279933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50ee3315-881b-40ca-b2c8-f48304b28c26", "tag": "dc66c46a-ad12-49b0-9b85-c22aece7728d"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:13:58.318850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.323635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.327922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.374568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Creating event network-changed:dc66c46a-ad12-49b0-9b85-c22aece7728d for instance 50ee3315-881b-40ca-b2c8-f48304b28c26 on hv-cinder-86021 Oct 06 08:13:58.378072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 08:13:58.378798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-658621a5-8aee-4370-9076-dc1eda8211b3 req-62403372-e45d-40e0-ac9b-bfb74c9402f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 08:13:58.382962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.382962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.383222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:58.383327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.383327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.383327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.383327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.395546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.compute.rpcapi [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 08:13:58.397120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] Releasing lock "compute-rpcapi-router" {{(pid=121076) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 08:13:58.424705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-30b1ab22-826b-4ea3-9a4b-f6caeb1069e3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1307 microversion: 2.1 time: 0.303273 Oct 06 08:13:58.433840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e4583552-9cf8-48f7-9772-e609a48caa30 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.627159 Oct 06 08:13:58.435643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 21/55] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:13:58.442326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 35/56] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:58 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:58.449067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:58.450190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:58.467113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.469286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.471387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.473129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.476103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.478452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.495752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:58.496465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:58.541123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.542053 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.542563 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.554063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.554895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.555597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.855773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:58.869938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:58.872646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:58.874025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-43fc6c68-2190-4e54-a198-f4ba4e7b1773 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1334 microversion: 2.20 time: 0.419659 Oct 06 08:13:58.876628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 36/57] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:58 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1334 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:13:58.903675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:58.909707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:58.932947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.933899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.934495 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:58.935412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:58.936313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:58.938916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.162566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:59.177059 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0fa023ab-c392-4c81-b684-31378844a948 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1273 microversion: 2.1 time: 0.300733 Oct 06 08:13:59.179824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 37/58] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:58 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1273 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:59.193382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:59.195066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:59.204188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.205784 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.206490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.207635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.208306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.208931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.623309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:59.636675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-96cc3b80-c161-4e9e-9906-076c52f7adc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1237 microversion: 2.1 time: 0.451265 Oct 06 08:13:59.642096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 38/59] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:59 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1237 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:59.647621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:59.658878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:59.673883 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.677644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.678288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.679216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.679826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.680406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.745322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:59.795186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6372f5ac-84be-41b7-8394-681e74549fa9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 1.356234 Oct 06 08:13:59.800693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 22/60] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:58 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:59.858658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:13:59.872632 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5cf4e053-9e08-4439-b2a8-b30104c778b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1295 microversion: 2.1 time: 0.228750 Oct 06 08:13:59.875511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 39/61] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:13:59 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1295 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:13:59.929011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:13:59.929011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:13:59.937459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.938358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.939215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:13:59.940616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:13:59.942296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:13:59.943462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.211430 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:00.212092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:00.221909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.224057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.224057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.224365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.225069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.225946 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.271358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:00.373553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:00.388420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-de1d3046-4ab6-48d6-8a82-206877718abc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1273 microversion: 2.1 time: 0.181745 Oct 06 08:14:00.437614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:00.447579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 40/62] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:00 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:00.467919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:00.477874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:00.484527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-76cb41d4-1bc5-4cd9-8753-ccc5c666916e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1340 microversion: 2.20 time: 0.564883 Oct 06 08:14:00.499094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 23/63] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:13:59 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1340 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:00.664614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:00.665936 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:00.674233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.675922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.676519 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.679358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.680222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.683505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.688295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:00.831659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:00.837395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:00.848765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.852272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.852775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.854080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:00.854538 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:00.854987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:00.948041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:01.012311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f6dc3ddd-700c-46ae-830e-484dfc5784ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1237 microversion: 2.1 time: 0.348839 Oct 06 08:14:01.014147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 41/64] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:00 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1237 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:01.041799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:01.044266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:01.061621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.062792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.063647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.066352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.068037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.068764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.754087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:01.772051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-62ca2268-50df-4585-bb06-6e471dbce1b8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.754568 Oct 06 08:14:01.774547 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 42/65] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:01 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:01.782032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:01.783476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:01.796065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.796987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.797643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.798796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.799438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.800013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.873882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:01.900770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6a84ee6a-46ff-4447-b60a-c1fa91ebd868 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 1.072306 Oct 06 08:14:01.912237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 24/66] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:00 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:01.929721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:01.932640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:01.947532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.948446 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.953388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.954412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:01.955117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:01.955718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:01.978170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:01.993683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-856533b7-ed50-4e4a-b96b-58f12932578e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1291 microversion: 2.1 time: 0.216446 Oct 06 08:14:01.993683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 43/67] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:01 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1291 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:02.051532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:02.052147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:02.074587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.077353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.077847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:02.078592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.079089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.079525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:02.173902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:02.193157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:02.200158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:02.201573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-08916e89-330a-4dbf-97c1-b41a42b45912 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1340 microversion: 2.20 time: 0.287851 Oct 06 08:14:02.214988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 25/68] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:01 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:02.258274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:02.274067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4950fee9-1083-4442-999d-b54241128116 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1293 microversion: 2.1 time: 0.226247 Oct 06 08:14:02.277723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 44/69] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:02 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:02.801287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:02.802401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:02.815607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.817219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.818559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:02.819553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.821532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.823292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:02.936216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:02.936937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:02.945176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.945674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.946148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:02.947619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:02.980504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:02.982187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:03.609878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:03.623315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-53e769f9-3c5c-4229-aea3-b9c27096ef8b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.825943 Oct 06 08:14:03.643827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 26/70] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:02 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:03.652452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:03.653620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:03.661799 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:03.662567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:03.663497 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:03.664455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:03.664979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:03.665505 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:03.880048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:03.896307 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-89570686-124a-41a8-9dbd-2b6928cb2412 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1279 microversion: 2.1 time: 0.250818 Oct 06 08:14:03.897432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 27/71] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:03 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:03.904365 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:03.905192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:03.917250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:03.921039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:03.921610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:03.921930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:03.922768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:03.927439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:03.928075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:03.939404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5731ce9b-a5a7-4e17-9be4-a80c66dcf900 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 1.015346 Oct 06 08:14:03.941635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 45/72] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:02 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:04.098188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1084773-96dd-49ad-b6a7-11e7f90ba5b1", "tag": "976a4aef-c6fd-42c8-aca2-3fb036d359e8"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:04.167194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.177164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.181931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.284949 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Creating event network-changed:976a4aef-c6fd-42c8-aca2-3fb036d359e8 for instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 on hv-cinder-86021 Oct 06 08:14:04.286720 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 06 08:14:04.289044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0ad9f2d1-dbfb-4c5c-b1fa-017844232f42 req-0a08c83e-8b09-47b9-acb1-3e22fa92a1bc service nova] Acquired lock "compute-rpcapi-router" {{(pid=121077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 06 08:14:04.293162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.293783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.294289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.298399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.298399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.298399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.354467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.compute.rpcapi [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 06 08:14:04.355802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] Releasing lock "compute-rpcapi-router" {{(pid=121077) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 06 08:14:04.446718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-badbf7a6-c32c-47a5-9194-d7b3ed7dbefe None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503581 Oct 06 08:14:04.448107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 46/73] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:04.456824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:04.462393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:04.467503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.477383 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.479301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.480429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.482199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.489872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.557567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:04.568400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:04.573127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:04.579304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-824b81cb-a585-4260-994b-840f0ed2edd8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.676512 Oct 06 08:14:04.580354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 28/74] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:03 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:04.597463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a957af7c-67a0-48fd-9982-e38551889d44", "tag": "7d45a844-7a13-48a7-b30a-540bde162269"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:04.615447 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.616078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.625027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.658415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] Creating event network-changed:7d45a844-7a13-48a7-b30a-540bde162269 for instance a957af7c-67a0-48fd-9982-e38551889d44 on hv-cinder-86021 Oct 06 08:14:04.687600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-57a3d859-8d9a-4481-b20b-e85b6c360430 req-dcbcc7d5-227a-44ff-95f8-77da1cb11da1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097192 Oct 06 08:14:04.687600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 29/75] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:04.709890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:04.711807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:04.725622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.726169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.726582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.727325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.727822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.728748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.731046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:04.739199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-77dba975-39d4-48e8-9918-8e4415d19561 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1299 microversion: 2.1 time: 0.289643 Oct 06 08:14:04.744699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 47/76] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:04 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1299 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:04.924352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:04.924960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:04.940847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.941507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.941760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:04.942639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:04.943132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:04.943555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.077852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:05.089773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-983c1462-a414-429c-86fc-722ba4c21ac4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1279 microversion: 2.1 time: 0.165315 Oct 06 08:14:05.115860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 48/77] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:04 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:05.126108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:05.127142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:05.135048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.135850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.137158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.140155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.147435 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.148235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.207228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=38 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:05.303253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:05.320680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8147dcd2-e3d3-48b2-83e4-8b738d29f21c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.639493 Oct 06 08:14:05.321918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 30/78] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:04 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:05.612435 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:05.613491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:05.626669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.627582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.628298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.629294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.629753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.630181 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.731747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:05.739556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1bdd3303-7a5d-41fe-b439-656193b7c067 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.621962 Oct 06 08:14:05.740625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 49/79] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:05 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:05.775611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:05.777217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:05.789537 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.794090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.794872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.797091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:05.798745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:05.799723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:05.940013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:05.948838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9f15ea45-56c1-4025-b931-7e77e91f6c3f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1299 microversion: 2.1 time: 0.181883 Oct 06 08:14:05.958990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 50/80] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:05 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:06.124245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:06.125386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:06.134682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.135714 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.136394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.137481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.138319 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.138976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.148189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.153283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:06.160197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.161884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.172807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2103c9ef-7661-4554-8689-575071bb38cd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.567876 Oct 06 08:14:06.191747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 31/81] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:05 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:06.318169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.330979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5e6bbc5a-2b89-46e9-829b-903591ab74a9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.210627 Oct 06 08:14:06.335298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 51/82] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:06 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:06.351977 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:06.353586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:06.361877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.363176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.363979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.365126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.366214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.366809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.538718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.547634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7841fc46-bede-4516-9e58-5395ca7e842e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.199468 Oct 06 08:14:06.548207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 32/83] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:06 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:06.641079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:06.655176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=30 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:06.655176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.655362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.655685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.672880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] Creating event network-changed:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:14:06.679591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-84bd7dc3-658e-44e1-948b-8784c00882b8 req-246436d6-8194-4ddb-9eb8-2bb6ed894ea1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041794 Oct 06 08:14:06.681140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 52/84] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:06.762254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:06.762850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:06.768957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.769625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.770059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.770816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.771437 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.771997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.925295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:06.933919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3afb1f84-5ef2-4752-a2c3-3f1049b9077e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.174980 Oct 06 08:14:06.945586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 33/85] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:06 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:06.988600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:06.990063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:06.996641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.997132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.997566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:06.998273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:06.998722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:06.999366 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.165564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.176114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8ce14444-8226-43ec-b22d-5cde150ea37e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.191870 Oct 06 08:14:07.176709 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 53/86] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:06 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:07.205397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:07.205997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:07.212344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.213486 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.216044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.216044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.216044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.216044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.356554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:07.357175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:07.357612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.363335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.363894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.364353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.365032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.365486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.365701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.365907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.367172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.368258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2cb088c3-7bc6-4c1f-84b8-40e867de1e19 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.166786 Oct 06 08:14:07.381877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 34/87] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:07 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:07.505935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.512631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-93211cd8-1121-49de-b7cd-acc4f05e12b8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.160128 Oct 06 08:14:07.523428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 54/88] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:07 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:07.570839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:07.571492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:07.577464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.577937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.578362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.579066 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.579513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.579936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.723269 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:07.731632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dc8779ea-32b1-4c65-8284-d7ea28da3943 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.164966 Oct 06 08:14:07.748359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 35/89] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:07 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:07.964090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:07.965414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:07.977134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.989143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.989143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:07.989143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:07.989143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:07.990895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.126186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.134172 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d29a95c0-652f-4620-9d1e-0846ad5fb727 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.179493 Oct 06 08:14:08.143276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 55/90] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:07 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:08.199168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:08.199779 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:08.207408 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.208129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.208767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.209755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.210218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.210647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.358174 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.366737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-591485a6-308e-4178-aa57-c2b3c93e9dc5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.172151 Oct 06 08:14:08.371003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 36/91] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:08 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:08.393981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:08.394346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:08.400322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.400890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.401377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.402248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.402704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.403156 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.537042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:08.537659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:08.538513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.541074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=12 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:08.545389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.545815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.546455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.547177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.547790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.548222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.548869 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.550588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.552017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8d0f42ed-2e2e-4e5f-b123-228796170db8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.162203 Oct 06 08:14:08.552840 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 56/92] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:08 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:08.699265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.707082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ac4b3e1a-0778-4e13-a5dc-c24fcc710673 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.173966 Oct 06 08:14:08.707931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 37/93] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:08 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:08.756515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:08.757123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:08.763500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.763884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.764390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.765118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:08.765567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:08.766207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:08.905706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:08.913260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5f86658a-fb4f-41aa-a20b-5331ae0ae785 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.161125 Oct 06 08:14:08.913877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 57/94] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:08 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:09.159713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:09.164576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:09.168345 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.168835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.169317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.170056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.170543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.170990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.329914 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.338527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-55ecadbf-794e-4caf-818b-96d278514243 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.183964 Oct 06 08:14:09.339575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 38/95] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:09 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:09.390583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:09.391165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:09.397246 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.397725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.398154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.398839 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.399316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.399793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.535999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.538335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:09.543240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9d1070e0-8cb8-4a93-9202-4c0664514135 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.156555 Oct 06 08:14:09.543815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 58/96] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:09 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:09.581240 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:09.582354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:09.592213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.593069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.593586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.594297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.594749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.595206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.731397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:09.733206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:09.739396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.740199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.740641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.741394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.741851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.742279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.777417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.785885 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.787376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.788492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7363d521-dcb3-429b-aeb5-7d482eec9277 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.213624 Oct 06 08:14:09.789058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 39/97] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:09 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:09.876256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:09.884881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-50967044-a1c6-49a1-9a0b-25e0ead6d2ce tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.158286 Oct 06 08:14:09.885451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 59/98] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:09 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:09.938078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:09.938742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:09.944864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.945407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.945848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:09.946636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:09.947652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:09.948080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.086336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:10.098308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6f0f1bce-aa57-4f2f-956d-19dc3cf3d973 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.164472 Oct 06 08:14:10.100079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 40/99] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:09 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:10.361444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:10.362051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:10.368505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.369374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.370107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.371025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.371509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.371909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.572711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:10.573331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:10.589920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.592738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.594497 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.598160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.600044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.601400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.904224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:10.911025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:10.913837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f44f19bd-ad0d-4424-8912-b00558494e51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.346971 Oct 06 08:14:10.916000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 41/100] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:10 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:10.920956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:10.921836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:10.928208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.929000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.929679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.930585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.931906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.932780 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.937109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-20f8d3e9-d5d9-4bc9-b7c7-0109f74810a4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.579404 Oct 06 08:14:10.938166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 60/101] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:10 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:10.958786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:10.959911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:10.967836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.968631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.969373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:10.970289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:10.970962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:10.971652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.104966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:11.113571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:11.115141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:11.116421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-912d57d0-5c9d-40e2-9a84-e03fc979ba40 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.199160 Oct 06 08:14:11.117075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 42/102] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:10 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:11.121954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:11.122649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:11.131833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.131833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.132263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.132979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.133417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.133843 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.222954 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:11.231783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1fb11d30-2e55-4842-b78b-80382f559e7f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.287505 Oct 06 08:14:11.232377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 61/103] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:10 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:11.286165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:11.294490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bc2838a0-059c-45b1-87f7-04da63203ab0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.176340 Oct 06 08:14:11.295110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 43/104] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:11 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:11.939641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:11.940154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:11.946437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.946924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.947383 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.948698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.949174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.949607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.977580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:11.980909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:11.984684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.985169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.985600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:11.986482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:11.987041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:11.987441 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.163491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.172352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-935aa677-c58f-4399-93e0-c6412d6ed593 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.198591 Oct 06 08:14:12.173241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 44/105] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:11 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:12.178001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f517d63c-e311-4c11-98b1-48e50f55b6fe", "tag": "d560f3d8-ea78-4a57-a945-9188174f94fc"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:12.197190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.197190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.197190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.206068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] Creating event network-changed:d560f3d8-ea78-4a57-a945-9188174f94fc for instance f517d63c-e311-4c11-98b1-48e50f55b6fe on hv-cinder-86021 Oct 06 08:14:12.211516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-04eb9c95-8613-4577-8f97-0eb0dbdc1712 req-9ff46c5a-9c31-4112-aa6c-45c3602498ef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036827 Oct 06 08:14:12.213032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 45/106] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:12.219854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:12.225417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:12.227544 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.229062 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.229309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.230096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.230622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.231192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.430583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.440593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.442139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.443422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-acb63290-b163-48a0-bd46-e33308b2c8d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.229458 Oct 06 08:14:12.445631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.455406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 46/107] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:12 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:12.456075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3c049a6f-8f92-4188-b1b0-3ef323f15c57 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.521658 Oct 06 08:14:12.468597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:12.468597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:12.468844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 62/108] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:11 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:12.474143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:12.478701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:12.488810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.488810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.488810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.488810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.489390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.489390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.489557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.489557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.489557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.490044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.490917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.491810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.720068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.729781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-783430ba-31f7-40ba-bf13-12918a8538e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.273109 Oct 06 08:14:12.729934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:12.730366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 47/109] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:12 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:12.743538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ee6a078f-f1d7-4b9e-bd92-a3bf7d49638c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.273537 Oct 06 08:14:12.744188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 63/110] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:12 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:12.789291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812fed79-2558-4d6b-b256-d23f79d7c85c", "tag": "f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:12.799827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:12.801388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:12.801956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:12.814593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] Creating event network-changed:f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9 for instance 812fed79-2558-4d6b-b256-d23f79d7c85c on hv-cinder-86021 Oct 06 08:14:12.820575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-38ba4d16-ef6e-4285-a910-4c36917fd2f5 req-0e834c06-f507-4a6e-8258-69f075653408 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034755 Oct 06 08:14:12.821889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 48/111] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:13.195435 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:13.196048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:13.203034 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.203564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.203996 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.204680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.205156 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.205560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.359683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.367783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b02c8688-d0d3-47fc-9ebf-9909c5237c06 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.176253 Oct 06 08:14:13.368397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 64/112] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:13 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:13.473852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:13.474561 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:13.481642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.482062 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.482504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.483225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.483695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.484112 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.485663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:13.486270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:13.492193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.492678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.493112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.493808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.494395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.494860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.652379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.656840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:13.663389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.665251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.667152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-27364bd6-d5c0-4053-a042-4c8b1dcfb255 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.197622 Oct 06 08:14:13.667988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 49/113] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:13 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:13.703938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.711616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b7546ff0-bece-4973-bbc5-df1364f28dbe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.229916 Oct 06 08:14:13.712271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 65/114] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:13 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:13.753951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:13.754684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:13.761839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.762415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.762927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.763712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.764230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.764871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.766330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:13.767223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:13.773851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.774407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.775265 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.776481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:13.777128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:13.777760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:13.910760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:13.925601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0aa3dbe6-727f-4bf1-b03c-bb3fa1bdb4b3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.176570 Oct 06 08:14:13.926188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 50/115] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:13 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:13.995401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:14.005118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f96e535d-a062-4897-a7ee-34c828f10def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.243345 Oct 06 08:14:14.005695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 66/116] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:13 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:14.394206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:14.394872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:14.401565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.402054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.402482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.403298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.403888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.407375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.694912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:14.695907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:14.697026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:14.700627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:14.708681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.708681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.708681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.710295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e9189f6a-3c0f-4088-840f-e617552f8dae tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.322251 Oct 06 08:14:14.711716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 51/117] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:14 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:14.723092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.724402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.727330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.737777 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:14.739625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:14.748930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.750316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.750959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.752092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.753022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.753872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.925877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:14.934164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:14.935805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:14.936915 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3bf1c984-5f25-4753-9447-882496c38898 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.247991 Oct 06 08:14:14.937470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 67/118] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:14 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:14.950772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:14.951843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:14.963331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.963658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.965251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:14.967476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:14.968224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:14.968846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.125421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:15.134734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dde93481-0a0e-4cf7-9cef-2e780b5d4ff3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.401433 Oct 06 08:14:15.136079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 52/119] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:14 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:15.142292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:15.143038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:15.149326 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.150110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.204395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.204395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.204395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.204395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.320512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:15.328824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5c51dc02-35df-43db-841f-e74db37b0893 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.191393 Oct 06 08:14:15.329472 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 53/120] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:15 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:15.473115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:15.473115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ad658f92-3d3a-4d96-bb61-e141abda8c5a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.486180 Oct 06 08:14:15.473115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 68/121] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:14 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:15.737861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:15.738481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:15.744882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.745354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.745785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.746470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.746918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.747358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.874737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:15.882628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b92b82f6-f015-40eb-8f10-a6ebac0504b0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.148661 Oct 06 08:14:15.883230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 54/122] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:15 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:15.964807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:15.965445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:15.971370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.971853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.972282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:15.972961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:15.973418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:15.973839 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.114459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.123507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.124938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.126126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ef57b9a8-c6c7-40c8-bda4-40dfcb1dd0a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.165895 Oct 06 08:14:16.126680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 69/123] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:15 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:16.160859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:16.161460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:16.168475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.168963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.169899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.170087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.170542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.170988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.311124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.319543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7bf4eadd-0f91-4a67-a42f-6da879ae38e1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.162446 Oct 06 08:14:16.320362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 55/124] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:16 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:16.355112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:16.355951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:16.362177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.362622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.363094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.363792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.364253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.364685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.494355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:16.495114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:16.496067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.501295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.501878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.502215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.502907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.503649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.504068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.507450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-69013d01-0dcc-478f-b1cc-df31b1170217 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.157551 Oct 06 08:14:16.523687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 70/125] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:16 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:16.641879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:16.653139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-047b2a8d-76c2-4530-9e0e-1295184a5cc4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.163248 Oct 06 08:14:16.653727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 56/126] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:16 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:16.906265 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:16.907069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:16.912703 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.913181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.913610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:16.914300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:16.914745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:16.915850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.063146 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.071790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-012b8156-60df-4a75-b6bb-f32ec8186c2e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.169360 Oct 06 08:14:17.072816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 71/127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:16 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:17.160764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:17.161452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:17.168452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.168844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.169290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.170026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.170655 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.171174 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.324434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.332494 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.333936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.335140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4b8b2458-a97c-453d-a902-be93af8494a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.178366 Oct 06 08:14:17.335714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 57/128] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:17 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:17.342123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:17.342962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:17.349011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.349491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.349934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.350615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.351099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.351542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.488282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.496405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0b804b1c-8447-470a-906f-fc4b3a93b432 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.158089 Oct 06 08:14:17.496977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 72/129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:17 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:17.531702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:17.532304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:17.538580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.539120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.539563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.540394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.540845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.541263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.678580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:17.679932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:17.687318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.687457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.687905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.688400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.689159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:17.689696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:17.690328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:17.695624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ffb829a5-05fb-4cdf-b4e7-94c9b2c54c45 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.167741 Oct 06 08:14:17.701523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 58/130] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:17 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:17.879859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:17.888404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-268a1f9e-5f5c-4dc6-b2ce-69eeb315154e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.216286 Oct 06 08:14:17.888899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 73/131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:17 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:18.096465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:18.097068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:18.103736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.104215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.104821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.105502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.106110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.106568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.249361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.257372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0b6e3b44-0664-4121-9c4c-c88c5a84d6e0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.164911 Oct 06 08:14:18.257941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 59/132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:18 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:18.362850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:18.363467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:18.371414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.371907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.372481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.373291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.373745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.374182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.515019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.521255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:18.521854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:18.526482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.528191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.529629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-de3a588c-948e-4d14-ae85-3f3c032f61e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.171468 Oct 06 08:14:18.529759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.530165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.530809 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 74/133] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:18 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:18.531194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.531959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.532416 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.532886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.676219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.685244 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fd8efe4a-beac-4612-b133-4d9860f53b24 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.167712 Oct 06 08:14:18.686235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 60/134] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:18 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:18.719757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:18.720401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:18.726455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.727223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.727702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.728397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.728848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.729308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.749820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:18.860844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:18.869395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fa5ffb59-9eee-4c0c-8054-30bd5bc5e9f2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.153551 Oct 06 08:14:18.869990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 75/135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:18 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:18.912265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:18.912883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:18.919134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.919611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.920038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:18.920706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:18.921150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:18.921564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.049423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.057858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c39ebd5a-b3e5-46d3-add5-eb9ebda959e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.149405 Oct 06 08:14:19.058422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 61/136] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:18 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:19.287355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:19.288031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:19.295617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.296201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.296682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.297455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.297960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.298765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.545077 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.555713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-35fa593f-46af-4a18-9984-fcb14deb2902 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.272183 Oct 06 08:14:19.557966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:19.557966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:19.560341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 76/137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:19 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:19.579815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.580308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.580912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.581611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.582061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.582480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.709262 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:19.709368 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:19.717101 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.717975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.718573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.719468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.720074 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.721049 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.726279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.740735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.744482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.745660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f9685c24-bc83-4f8f-9bf5-a7aef7074f48 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.193479 Oct 06 08:14:19.749821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 62/138] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:19 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:19.885418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:19.893149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-88e1dc42-3962-49d9-af86-6b69906bdf50 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.188597 Oct 06 08:14:19.893881 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:19.894003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 77/139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:19 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:19.894293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:19.903822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.904309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.904766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:19.905702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:19.906192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:19.906733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.042865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.054759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fccad9f7-b7aa-4209-886d-db50f92bcf37 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.165676 Oct 06 08:14:20.068511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 63/140] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:19 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:20.080832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:20.081453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:20.088109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.088510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.088949 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.089677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.090133 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.090558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.242603 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.251188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-838de6b4-b27b-4313-93ac-637acf016487 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.174196 Oct 06 08:14:20.251767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 78/141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:20 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:20.583684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:20.584923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:20.591087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.597180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.597180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.597180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.597180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.597539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.738972 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.749244 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-db44c711-451d-49b9-9bfe-fb8d0f89aea8 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.169445 Oct 06 08:14:20.749823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 64/142] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:20 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:20.778188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:20.778997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:20.785221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.785709 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.786207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.786907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.787542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.787978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.844871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1084773-96dd-49ad-b6a7-11e7f90ba5b1", "name": "network-vif-plugged", "status": "completed", "tag": "976a4aef-c6fd-42c8-aca2-3fb036d359e8"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:20.853630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:20.855861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.856332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.856753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.868206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] Creating event network-vif-plugged:976a4aef-c6fd-42c8-aca2-3fb036d359e8 for instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 on hv-cinder-86021 Oct 06 08:14:20.873762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-84831359-d1ad-4e3d-8778-7ad67c67c191 req-55a794da-6832-435f-89ae-afa75b664aa8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092280 Oct 06 08:14:20.874351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 65/143] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:20.918139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:20.918923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:20.925158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.925308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.929371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.929371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.929371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:20.929371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:20.929871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:20.933221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.934738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:20.935993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8bb4c59f-9ce5-4a96-91a3-d352bbcb5749 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.162288 Oct 06 08:14:20.942834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 79/144] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:20 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:21.069083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:21.079908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:21.080515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:21.080645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e5b1d988-9e3b-495b-bcb7-bc73897303da tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.168008 Oct 06 08:14:21.090516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.090805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.091336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.091479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 66/145] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:20 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:21.092468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.093109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.093772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.234038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:21.245734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-04988b8e-3209-46c9-83c1-420ce73ecf1c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.170171 Oct 06 08:14:21.246310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 80/146] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:21 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:21.279403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:21.280025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:21.288151 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.290024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.290024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.290358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.290995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.291412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.296077 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:21.439395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:21.445811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3ff9d53a-7ce1-41ee-9ac2-d594b56b7bd2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.171460 Oct 06 08:14:21.447339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 67/147] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:21 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:21.775700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:21.776648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:21.784030 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.786630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.786630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.786630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.787322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.787781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.931276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:21.939421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-90d7df9c-23c3-4f75-a4c9-e2645d0f6b61 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.169963 Oct 06 08:14:21.940004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 81/148] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:21 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:21.962455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:21.963102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:21.969717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.970267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.970702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:21.971424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:21.973009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:21.973009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.107414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:22.108075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:22.120524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.121013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.121576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.122292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.122775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.123210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.198018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:22.206249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:22.207821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:22.209106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9b9844bc-52da-47a7-9ce3-7440b2265643 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.251246 Oct 06 08:14:22.209918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 68/149] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:21 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:22.288516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:22.294155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:22.314606 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.315129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.315625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.319943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.320794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.322216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.881086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:22.903467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-96e32ec0-4f7b-4cc3-beb0-b7cf5082b3a9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.801093 Oct 06 08:14:22.904074 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 82/150] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:22 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:22.909110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:22.909720 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:22.924124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.924271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.925160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:22.926034 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:22.926645 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:22.939671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.225809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.239489 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-04fa3247-2d2f-49ba-89df-5513ec68449b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.970633 Oct 06 08:14:23.242346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 69/151] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:22 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:23.260287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:23.261815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:23.282338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.283254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.294721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.296551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.300973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.300973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.468777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.478871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d2e6cd48-f980-4d2a-a5c2-8e1846bdd6b7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.572204 Oct 06 08:14:23.479518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 83/152] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:22 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:23.504845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:23.513183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:23.517139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.517663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.518045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.518740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.519219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.519690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.584773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.594908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a048d7b-09d2-47e2-81b0-00f1a18fafe9 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.350181 Oct 06 08:14:23.595369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 70/153] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:23 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:23.686015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.694205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.695684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:23.697465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-005cfca3-9cdf-4c1a-8a87-73119860ef65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.200250 Oct 06 08:14:23.698023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 84/154] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:23 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:23.926494 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:23.927124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:23.933488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.933968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.934399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:23.935119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:23.935563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:23.935981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.092283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.101300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6376e23e-2912-4fa9-8d36-b2388477acdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.178650 Oct 06 08:14:24.114309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 71/155] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:23 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:24.267909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:24.268518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:24.271482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:24.275057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.275551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.275992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.276733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.277137 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.277561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.428155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.436535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8411f1a1-54a7-495f-9a47-01a1e3ca2ca3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.172498 Oct 06 08:14:24.437314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 85/156] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:24 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:24.506510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:24.507155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:24.513684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.514197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.514626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.515888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.515987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.516334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.621429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:24.622431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:24.628786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.629441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.630028 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.630725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.631260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.631675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.678527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.688925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d66cfb64-b899-4f4b-8b8c-5abe90347cc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.186696 Oct 06 08:14:24.689519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 72/157] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:24 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:24.723247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:24.724006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:24.734565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.735284 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.735913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.736687 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:24.737485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:24.737968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:24.782904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.794143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-34279b5c-af7b-484e-a8cb-4aa99bb034a5 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.177044 Oct 06 08:14:24.794749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 86/158] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:24 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:24.881181 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.889555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.891009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:24.892096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-30ce26f5-27ec-434b-886e-0e5f5815629a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.173065 Oct 06 08:14:24.892651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 73/159] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:24 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:25.135935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:25.135935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:25.145534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.145947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.146544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.147643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.151309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.151309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.310052 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:25.323794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4dd93ee7-a231-423d-a849-1325cd6a1c0a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.200928 Oct 06 08:14:25.324991 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 87/160] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:25 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:25.460753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:25.461553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:25.467237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.467723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.468154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.468828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.469276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.469696 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.601205 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:25.625316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-85a30fb3-c64c-4aa1-9e3b-fef684937350 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.166650 Oct 06 08:14:25.625316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 74/161] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:25 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:25.714568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:25.714858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:25.721019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.721495 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.721921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.722664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.723117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.723570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.816251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:25.816862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:25.825413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.825413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.825716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.826354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.826823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.827261 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.863320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:25.871467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-662305cc-2163-45a3-b298-e8e129343436 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.162874 Oct 06 08:14:25.872325 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 88/162] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:25 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:25.917470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:25.918214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:25.924159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.924676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.925109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.928742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:25.928742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:25.928742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:25.974575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:25.984418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5746a83d-817f-4331-aac8-ea2866f05e2f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.171993 Oct 06 08:14:25.985334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 75/163] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:25 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:25.990587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a957af7c-67a0-48fd-9982-e38551889d44", "name": "network-vif-plugged", "status": "completed", "tag": "7d45a844-7a13-48a7-b30a-540bde162269"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:26.001061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.001543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.001961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.014677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] Creating event network-vif-plugged:7d45a844-7a13-48a7-b30a-540bde162269 for instance a957af7c-67a0-48fd-9982-e38551889d44 on hv-cinder-86021 Oct 06 08:14:26.019832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-2a913a8a-c65a-4581-9d7f-366694479c59 req-7957cdd0-cb97-4722-b506-5a1a9e1cadc4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Oct 06 08:14:26.020493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 76/164] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:26.087287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:26.096365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:26.096365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:26.096365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3fa0d9e0-5b42-48ea-9104-334cf94aecd5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.181291 Oct 06 08:14:26.096736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 89/165] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:25 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:26.348463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:26.349146 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:26.356420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.356908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.357335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.358246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.358693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.359268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.496189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:26.504359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-95b8667b-b54f-40ab-9b87-1335baf889c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.160160 Oct 06 08:14:26.504920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 77/166] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:26 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:26.646502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:26.647159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:26.653464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.653942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.654369 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.655134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.655579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.655993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.800626 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:26.813968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d5b00b7c-9a8a-4d61-ac49-da42c62b0eb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.168629 Oct 06 08:14:26.813968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 90/167] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:26 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:26.895439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:26.896111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:26.902451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.902931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.903410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:26.904083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:26.904526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:26.904938 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.008384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:27.009720 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:27.015706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.016380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.017006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.020524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.020524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.020524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.036477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.045282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-98308cab-5f6b-4f8c-a851-d291d8504223 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.153340 Oct 06 08:14:27.045873 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 78/168] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:26 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:27.121535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:27.122132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:27.128719 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.129144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.129949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.130646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.131129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.131892 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.155998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.166810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1a559ea2-7942-4d0c-8eaf-4a67c51bca8a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.162888 Oct 06 08:14:27.167439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 91/169] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:27 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:27.268519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.277265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.278694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.279829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-310c3093-71c0-4e9c-89aa-516a87af09a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.162946 Oct 06 08:14:27.280485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 79/170] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:27 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:27.526410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:27.527051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:27.533068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.533545 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.534002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.534745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.535216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.535636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.539434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:27.663952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:27.672428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-18f0e514-6e56-4d5c-a631-740d658b0a80 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.150017 Oct 06 08:14:27.672983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 92/171] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:27 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:27.840945 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:27.841858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:27.848421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.848908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.849331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:27.850963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:27.850963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:27.851131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.011385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.019031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fdc03577-1d8f-4371-8eec-4c819e0e412c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.184691 Oct 06 08:14:28.019600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 80/172] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:27 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:28.035772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ee3315-881b-40ca-b2c8-f48304b28c26", "name": "network-vif-plugged", "status": "completed", "tag": "dc66c46a-ad12-49b0-9b85-c22aece7728d"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:28.046808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.047346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.047770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.059683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] Creating event network-vif-plugged:dc66c46a-ad12-49b0-9b85-c22aece7728d for instance 50ee3315-881b-40ca-b2c8-f48304b28c26 on hv-cinder-86021 Oct 06 08:14:28.065614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-d0f3f141-dc0e-4acf-9a4e-f39be1909157 req-d312b3f6-b53f-420f-a9c0-3aabcc424184 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033418 Oct 06 08:14:28.066405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 93/173] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:28.068792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:28.069552 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:28.076243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.076725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.077159 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.077900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.078350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.078768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.190247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:28.190996 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:28.197892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.198379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.198815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.199530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.199980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.200466 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.207455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.216274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e8247d2f-2212-416e-9455-7ece4441d217 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.151713 Oct 06 08:14:28.217055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 81/174] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:28 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:28.305271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:28.306595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:28.312527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.313014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.313456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.314143 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.314593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.315036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.345919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.353884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c3c5fcab-8c54-44f0-b23f-dd0453ee3732 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.168048 Oct 06 08:14:28.354459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 94/175] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:28 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:28.445099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.454117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.455593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.456690 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-698030b6-e892-4abf-b3e9-377c80c66a21 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.155357 Oct 06 08:14:28.457248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 82/176] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:28 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:28.695193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:28.695700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:28.701941 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.702429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.702863 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.703578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:28.704031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:28.704452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:28.830607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:28.838391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c44205bb-c9ae-4508-9a0b-986aec999927 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.147124 Oct 06 08:14:28.838968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 95/177] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:28 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:29.043014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:29.043647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:29.049572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.050106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.050542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.051250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.051703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.052130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.183838 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.191519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e38bafe5-0b21-4d08-8993-5d0c2d9c6f89 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.153009 Oct 06 08:14:29.192121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 83/178] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:29 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:29.240221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:29.240823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:29.246838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.247344 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.247772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.248445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.248925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.249393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.376180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:29.376773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:29.383076 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.383651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.384108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.384791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.385232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.385645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.386373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.393964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ef2cf01f-8c94-425d-96b6-2355eb5aa4e8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.157700 Oct 06 08:14:29.394532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 96/179] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:29 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:29.404741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:29.482079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:29.482673 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:29.488483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.488959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.489385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.490056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.490549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.490909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.513777 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.521389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6d5ba025-ba1e-453b-9fba-141adada5e4e tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.149054 Oct 06 08:14:29.521958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 84/180] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:29 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:29.616297 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.625469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.626963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:29.628051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a9613924-def5-42b1-9cc2-d4fc2446ca87 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.150567 Oct 06 08:14:29.628874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 97/181] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:29 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:29.861460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:29.862057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:29.868129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.868689 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.869117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:29.869815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:29.870255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:29.870665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.003507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.012296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d1864ce3-d64f-45c1-b071-8a004e1431cb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.154590 Oct 06 08:14:30.012870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 85/182] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:29 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:30.215437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:30.216047 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:30.222013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.222490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.223009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.223679 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.224123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.226419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.356004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.363619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-17f56bb9-0f63-447a-8532-8c83685642d2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.152716 Oct 06 08:14:30.364206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 98/183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:30 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:30.417510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:30.418134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:30.423918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.424396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.424826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.425502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.425946 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.426356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.545098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:30.545699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:30.551615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.552025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.552459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.553138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.553592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.554098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.557131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.564714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-71786f7b-779c-4681-911a-5ef95c661d2f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.151597 Oct 06 08:14:30.565420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 86/184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:30 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:30.654619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:30.655387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:30.661545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.662032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.662462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.663234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:30.663696 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:30.664325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:30.683454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.691046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-126940aa-1de8-465d-b83e-cf0e27f655f4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.150437 Oct 06 08:14:30.691618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 99/185] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:30 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:30.796993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.805099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.807179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:30.808276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e388eb2e-a896-4a57-9383-c8937a006880 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.157681 Oct 06 08:14:30.808882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 87/186] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:30 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:31.035270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:31.035878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:31.041880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.042367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.042796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.043504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.044088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.044515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.179572 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.187434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-bee4e3fc-50b9-4c3f-abae-f42ed2ca31c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.156124 Oct 06 08:14:31.188010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 100/187] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:31 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:31.388276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:31.388794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:31.395418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.395418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.395816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.396533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.397047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.397464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.527975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.535666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1dff450d-59ba-4e5e-b9ca-3e2eb712e1a8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.151965 Oct 06 08:14:31.536230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 88/188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:31 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:31.587493 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:31.588748 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:31.594617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.597780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.597780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.597780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.597780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.598121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.714191 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:31.714796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:31.721185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.721672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.722212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.722958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.723422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.723846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.727448 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.735908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-aa2ef62e-5494-4110-b226-84572f3cd56b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.152241 Oct 06 08:14:31.736797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 101/189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:31 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:31.833929 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:31.834682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:31.841450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.842007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.842503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.843213 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:31.843651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:31.844066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:31.859001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.866681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9b6bbe65-62df-4cb5-8d0c-a15d52615730 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.156751 Oct 06 08:14:31.867268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 89/190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:31 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:31.974927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.983308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.984787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:31.985811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-849012af-d3f2-429c-b003-a204764e44e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.155965 Oct 06 08:14:31.986364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 102/191] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:31 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:32.211876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:32.212491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:32.218881 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.219422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.219834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.220524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.220967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.221431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.359709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:32.367528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-68c28080-c43b-40f8-9b2c-21924c267dc3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.159932 Oct 06 08:14:32.368404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 90/192] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:32 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:32.559565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:32.560175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:32.566133 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.567341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.568177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.568826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.569284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.569706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.730908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:32.741586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7c9d3fa3-f788-43f8-8d51-926030c9285b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.185767 Oct 06 08:14:32.760208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 103/193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:32 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:32.763660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:32.771385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:32.771385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.771738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.772183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.773122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.773588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.774094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.893221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:32.894805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:32.903809 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.904660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.906068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.907138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:32.908109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:32.908750 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:32.946909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:32.960261 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1adc7c9e-8dbf-414f-9cfd-607213e880c9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.203710 Oct 06 08:14:32.960959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 91/194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:32 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:33.011557 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:33.012219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:33.019157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.019646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.020081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.020775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.021228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.021646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.082977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.100742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4054fcad-a280-4039-996e-e014f207c73b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.212319 Oct 06 08:14:33.117919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 104/195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:32 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:33.211397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.223003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f517d63c-e311-4c11-98b1-48e50f55b6fe", "name": "network-vif-plugged", "status": "completed", "tag": "d560f3d8-ea78-4a57-a945-9188174f94fc"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:33.224672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.226343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.227962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-000e7a1a-6a21-4214-b149-7c3ab234bd89 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.221247 Oct 06 08:14:33.229436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 92/196] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:33 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:33.235776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.235776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.236453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.258817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] Creating event network-vif-plugged:d560f3d8-ea78-4a57-a945-9188174f94fc for instance f517d63c-e311-4c11-98b1-48e50f55b6fe on hv-cinder-86021 Oct 06 08:14:33.265237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-8223fa2a-9084-4955-9974-2470265ce6d3 req-14379db9-6ce8-4797-ba2b-45156af0b5d4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047758 Oct 06 08:14:33.265937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 105/197] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:33.394281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:33.394281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:33.399657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.400176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.400603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.402407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.403248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.403815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.557784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.566958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0c20b706-ae38-407e-aac1-2537c5f30732 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.179102 Oct 06 08:14:33.567789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 93/198] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:33 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:33.767565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:33.768260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:33.779080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.780132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.781960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.783624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.784730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.785868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.958519 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:33.968215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-48d3d719-ff6a-45e8-bfa6-87d855f3827f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.204802 Oct 06 08:14:33.968704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 106/199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:33 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:33.986677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:33.987357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:33.993380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.994519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.995052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:33.995740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:33.996180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:33.996593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.131073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:34.131711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:34.141975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.142616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.143169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.145125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.146109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.147560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.184565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.193505 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9b57b8f0-65f0-4124-82ff-290465073e15 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.211053 Oct 06 08:14:34.194425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 94/200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:33 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:34.260370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:34.260910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:34.268364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.268908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.269674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.270873 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.271354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.271815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.345808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.355173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d42ae204-1bfb-43db-bf7e-db7cfc6ea77f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.230318 Oct 06 08:14:34.356089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 107/201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:34 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:34.431169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.440025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.441818 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.443046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-575cf382-6756-485a-9324-634beb872ed5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.188749 Oct 06 08:14:34.446397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 95/202] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:34 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:34.590951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:34.591627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:34.597667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.598148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.598581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.599295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:34.599740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:34.600161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:34.736618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:34.745205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-128afbef-1bb1-4689-b594-c3a861dc79a0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.158645 Oct 06 08:14:34.749170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 108/203] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:34 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:34.993757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:34.994428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:35.000707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.001200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.001657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.002527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.003009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.003704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.137178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.145767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-68e54afe-9320-4f71-b86d-525498c17816 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.155447 Oct 06 08:14:35.146527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 96/204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:34 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:35.217422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:35.218348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:35.225597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.226208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.226841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.230288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.230288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.230288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.280604 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "name": "network-vif-plugged", "status": "completed", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:35.289908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.290386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.291477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.302862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] Creating event network-vif-plugged:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:14:35.308232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-2769f160-5182-4091-8bf5-dd3029dcdb2d req-9815321f-8682-4210-8506-f1e1653ff1e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Oct 06 08:14:35.309170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 97/205] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:35.385068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:35.385068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:35.386190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.391807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.392504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.393149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.394029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.395061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.395415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.402139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1bbfb04d-44fb-4e93-98db-51fdceb265f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.188837 Oct 06 08:14:35.403334 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 109/206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:35 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:35.474266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:35.474892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:35.482151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.482783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.487345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.488225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.489728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.489728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.493971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:35.566795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.576321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b62032f1-b9c3-4e19-8cfd-1ebcbbea7763 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.197842 Oct 06 08:14:35.576884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 98/207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:35 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:35.627805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.637848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.639343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.640453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6017373a-dbc6-41f8-a65f-8ead0867fb82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.170930 Oct 06 08:14:35.641014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 110/208] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:35 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:35.770556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:35.771423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:35.778287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.778767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.779628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.780344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:35.780344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:35.780781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:35.919091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:35.933622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-76c15b0f-b1f8-4586-889a-31b8298978fe tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.168805 Oct 06 08:14:35.934698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 99/209] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:35 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:36.170433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:36.170921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:36.177838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.178329 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.178765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.180309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.180309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.180539 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.425825 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:36.426584 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:36.433670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.434397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.435075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.435979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.436653 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.437178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.439994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:36.449108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b0b27143-9ed0-4afb-acf3-37217689a381 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.283685 Oct 06 08:14:36.449686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 111/210] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:36 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:36.600841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:36.601549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:36.607555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:36.609998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.610673 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.611280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.612149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.614281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.614899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.624591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-45862369-0e75-46d1-8de9-2501a3f15f85 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.203101 Oct 06 08:14:36.636223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 100/211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:36 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:36.666531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:36.667324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:36.673276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.673851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.674342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.676299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.676299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.676825 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.833931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:36.838997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:36.844473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:36.845912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:36.847044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d8f53771-d391-4592-a0cb-9d0a690d9f68 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.185364 Oct 06 08:14:36.849332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 101/212] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:36 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:36.958403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:36.959036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:36.966895 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.967380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.967817 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.968499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:36.968946 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:36.969356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:36.996802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:37.011497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-312227b7-d61a-4dab-bfff-a360d57f0910 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.415758 Oct 06 08:14:37.012440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 112/213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:36 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:37.213651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:37.222784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1faa1dbb-9623-4c22-8a7b-8418c0c40360 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.269666 Oct 06 08:14:37.223727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 102/214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:36 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:37.473373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:37.475905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:37.482742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.483301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.484268 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:37.484480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.484926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.485350 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:37.660276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:37.660276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:37.660276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.660276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.660950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:37.660950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.660950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.660950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:37.667873 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:37.675462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1296cc7f-58b7-4ef9-8d9e-e752c6de7dbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.206787 Oct 06 08:14:37.676043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 113/215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:37 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:37.797691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:37.807683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d7a63195-3246-4c2b-baf7-e24120c67a8e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.161893 Oct 06 08:14:37.808303 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 103/216] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:37 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:37.876099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:37.876715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:37.885526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.886209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.886824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:37.887871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:37.888690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:37.889270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.053852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:38.053852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:38.053852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.053852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.054509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.054509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.054671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.054788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.054788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.054984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.054984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.054984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-779eb576-b4cf-43a9-afdc-b03c16adb086 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.184439 Oct 06 08:14:38.055250 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 114/217] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:37 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:38.172495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.180658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d573620e-93a0-4a6c-ad5a-16b132ff8a9a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.150465 Oct 06 08:14:38.181855 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 104/218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:38 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:38.246597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:38.247253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:38.253480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.253963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.254600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.256117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.256799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.257283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.385245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.393096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-eccdaf30-f0d4-4207-a061-58f493c5fd97 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.151503 Oct 06 08:14:38.393683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 115/219] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:38 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:38.698308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:38.698826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:38.704909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.705440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.705877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.706559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.707043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.707469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.833592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:38.834819 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:38.842269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.842836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.843521 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.844472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:38.845135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:38.845769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:38.856570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:38.864758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ba2a9096-09f9-4668-a2df-313e12443def tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1362 microversion: 2.1 time: 0.170931 Oct 06 08:14:38.866554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 105/220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:38 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:39.004637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.012893 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-38db4ebe-54f1-4af0-b746-9bd15316191d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.185564 Oct 06 08:14:39.013473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 116/221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:38 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:39.081941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:39.082546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:39.090824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.091336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.091766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.092465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.092916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.093342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.204072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:39.204618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:39.211052 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.211541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.211970 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.212901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.212901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.214160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.262591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.272704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.274445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.276144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1c860031-c35a-4b91-93e1-0fa36548c498 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.197855 Oct 06 08:14:39.276965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 106/222] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:39 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:39.389182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812fed79-2558-4d6b-b256-d23f79d7c85c", "name": "network-vif-plugged", "status": "completed", "tag": "f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:39.398763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.400096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.400531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.400960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.406607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fa04abd6-81b8-4ebd-a282-586819495348 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.207399 Oct 06 08:14:39.407219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 117/223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:39 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:39.412408 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] Creating event network-vif-plugged:f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9 for instance 812fed79-2558-4d6b-b256-d23f79d7c85c on hv-cinder-86021 Oct 06 08:14:39.422287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:39.422477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-9423060e-d9b4-47c8-9ef6-11ff31758f24 req-a7c142ac-6cbb-4221-bf3f-8b54b0c96d0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037247 Oct 06 08:14:39.422899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:39.423258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 107/224] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:39.429105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.429584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.430015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.430699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.431868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.432691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.575760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:39.584147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cdcc5959-20b3-4a0b-920c-da6ade3ea22c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.165596 Oct 06 08:14:39.584912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 118/225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:39 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:39.891662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:39.894691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:39.898800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.899545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.900705 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:39.901530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:39.901987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:39.902408 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.036233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:40.036891 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:40.043032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.043924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.044388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.045083 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.045531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.045947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.046307 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.059723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-110d04f0-3ecd-455a-9018-910b8418ad0a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1548 microversion: 2.1 time: 0.169044 Oct 06 08:14:40.059723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 108/226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:39 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:40.079932 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:40.080722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:40.087180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.088801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.091832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.093110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.093956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.094676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.216766 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.227407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f105ba2b-54d9-495d-a521-90f1aa748c69 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.194798 Oct 06 08:14:40.228862 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 119/227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:40 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:40.256228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5c37d906-de9d-4f52-9eb6-4bb1221e5a09 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180322 Oct 06 08:14:40.257158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 109/228] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:14:40 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:40.302693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:40.303847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:40.310959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.311913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.312474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.313251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.314158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.314741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.447290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:40.452349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:40.471812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.472702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.473218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.474031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.474534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.475167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.481019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.491083 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.494216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.495869 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b82f73c2-21c4-4c99-83b1-4670d991d007 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.197168 Oct 06 08:14:40.496433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 120/229] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:40 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:40.608590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:40.609206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:40.623573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.624402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.627486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.631819 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:40.632307 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:40.632746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:40.813091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.820030 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-795c9a3b-4d5a-42f7-a0b2-3e82cc5ec95d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1367 microversion: 2.1 time: 0.216143 Oct 06 08:14:40.820615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 121/230] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:40 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:40.825017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:40.840419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-be59c427-8e04-46d9-9ccc-6cc00e57af56 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1315 microversion: 2.1 time: 0.414575 Oct 06 08:14:40.852295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 110/231] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:40 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:41.253991 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:41.255732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:41.262386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.262994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.263702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.264345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.264929 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.265582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.440056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:41.450516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7557cb6c-b8d2-4584-9a97-e5bf7b83619c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.201788 Oct 06 08:14:41.451143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 122/232] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:41 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:41.533800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:41.537258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:41.545031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.545638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.546149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.546916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.547608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.548199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.772285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:41.785370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:41.787510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:41.788877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5661adb0-f01f-418f-841c-79309353beb3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1408 microversion: 2.20 time: 0.269001 Oct 06 08:14:41.790346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 111/233] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:41 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:14:41.846835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:41.847704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:41.857391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.857947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.864248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:41.865585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:41.871992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.873203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.875225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.875728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.877085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.877785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.879612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:41.881194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:41.883250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:41.887720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.176937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:42.178832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:42.192106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f5dba160-88e5-4810-9463-b106de659ff0 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1501 microversion: 2.1 time: 0.331580 Oct 06 08:14:42.193533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 112/234] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:41 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1501 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:42.213339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e7861202-8ebb-4a28-8a45-c82031c30bbd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1558 microversion: 2.1 time: 0.371762 Oct 06 08:14:42.213937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 123/235] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:41 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1558 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:42.237872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:42.238612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:42.245896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.246688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.247335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.248259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.248887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.249482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.430599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-76a151ea-e72d-40a8-b476-f290e49d7122 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196853 Oct 06 08:14:42.432592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 113/236] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:14:42 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:42.474217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:42.475380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:42.485275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.486474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.487143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.488029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.488677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.489249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.579650 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a957af7c-67a0-48fd-9982-e38551889d44", "tag": "7d45a844-7a13-48a7-b30a-540bde162269"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:42.605354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.606445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.607412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.632682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] Creating event network-changed:7d45a844-7a13-48a7-b30a-540bde162269 for instance a957af7c-67a0-48fd-9982-e38551889d44 on hv-cinder-86021 Oct 06 08:14:42.648035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-cd4c6471-8f6a-4eec-a0da-2cb461b81851 req-c6e01af9-8022-481e-8b3f-407c50f77a27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072132 Oct 06 08:14:42.649315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 114/237] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:14:42.817317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:42.818949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:42.844758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:42.852819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.857790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.858385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.859228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:42.865497 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:42.866040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:42.998818 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:43.007304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-20935568-9b13-433e-a7e8-c452a9d31360 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.537506 Oct 06 08:14:43.011173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 124/238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:42 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:43.143970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:43.166484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:43.168726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:43.173744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-21a3a37f-0ccc-451e-9b2e-ee00f3437809 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1599 microversion: 2.20 time: 0.361652 Oct 06 08:14:43.180030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 115/239] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:14:42 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1599 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:14:43.219522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:43.220448 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:43.228316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:43.229175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:43.229833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:43.231279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:43.232174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:43.232778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:43.543620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7cbbf5d7-a224-4268-8392-cc79eec70b81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.328289 Oct 06 08:14:43.545355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 125/240] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Oct 6 08:14:43 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-interface => generated 284 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:14:44.041778 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:44.042992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:44.054486 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:44.055482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:44.056786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:44.058092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:44.059035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:44.059830 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:44.625088 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:44.635582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3bc52490-6de6-44f0-a373-6bd14db068dd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.602576 Oct 06 08:14:44.651215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 116/241] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:44 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:44.843117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f517d63c-e311-4c11-98b1-48e50f55b6fe", "tag": "d560f3d8-ea78-4a57-a945-9188174f94fc"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:44.854993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:44.855553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:44.855989 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:44.871002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] Creating event network-changed:d560f3d8-ea78-4a57-a945-9188174f94fc for instance f517d63c-e311-4c11-98b1-48e50f55b6fe on hv-cinder-86021 Oct 06 08:14:44.877743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-ea4fcbec-3021-40e0-9d8d-28ea785b4a04 req-14c01457-c9fc-418a-ac24-91d75b09f369 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038276 Oct 06 08:14:44.881070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 126/242] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:45.377157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ef24064-d71d-4c7a-85f6-232cf833665b"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:45.379824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:45.393096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:45.393096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:45.393096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:45.394524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:45.395220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:45.398302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:45.671927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:45.672879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:45.694654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:45.702512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:45.703058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:45.703846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:45.704260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:45.704684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:45.926548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:45.930230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:45.937348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8c59ddf5-5a14-4388-bedc-c9e2a0147783 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1321 microversion: 2.1 time: 0.282118 Oct 06 08:14:45.951251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 127/243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:45 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:45.963525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:45.976752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:45.977337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:45.978043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:45.995080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] Creating event network-changed:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:14:46.002406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-ccda9c72-a4eb-42a2-bd00-759b7292e0ba req-35fe4684-b4bb-4736-91da-7050f888bf6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048870 Oct 06 08:14:46.004328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 128/244] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:46.968611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:46.970423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:46.980615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:46.982045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:46.988660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:46.988660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:46.988660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:46.988660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:47.275264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:47.284871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b182affb-663d-40e5-9a6d-3ff2cf000fc5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1513 microversion: 2.1 time: 0.322667 Oct 06 08:14:47.285467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 129/245] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:46 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:14:47.318705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:14:47.322080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:47.328851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:47.329440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:47.329930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:47.330841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:47.331481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:47.332055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:47.360504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'flavor' on Instance uuid 812fed79-2558-4d6b-b256-d23f79d7c85c {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:14:47.926084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2422bff9-7993-4d75-aa86-709050ab36f3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c/action" status: 200 len: 32 microversion: 2.1 time: 0.617664 Oct 06 08:14:47.931868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 130/246] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:14:47 2022] POST /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c/action => generated 32 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:14:47.938045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:47.939042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:47.946763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:47.947596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:47.948039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:47.948752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:47.949210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:47.949642 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:48.102344 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:48.111341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7a7ac16c-1d39-499b-9654-0ce8f0134745 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.177229 Oct 06 08:14:48.111921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 131/247] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:47 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:48.625949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9ed1594c-b607-41a0-80e1-4cac8b8a1496 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "POST /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.252699 Oct 06 08:14:48.629063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 117/248] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:14:45 2022] POST /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26/os-volume_attachments => generated 194 bytes in 3257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:14:49.135824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:49.136452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:49.142599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:49.143113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:49.143549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:49.144248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:49.144696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:49.145119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:49.288628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:49.297827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9f39efa7-7a63-416c-a477-fb42d3e34481 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.166006 Oct 06 08:14:49.298395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 132/249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:49 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:50.323518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:50.324213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:50.332728 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:50.333226 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:50.333664 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:50.334371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:50.334824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:50.335337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:50.472804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:50.480594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9a775360-9fef-4f1c-89cf-e2b9383bc042 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.162556 Oct 06 08:14:50.485114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 118/250] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:50 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:51.503953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:51.504620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:51.510679 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:51.511194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:51.511636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:51.512310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:51.512756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:51.513173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:51.649021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:51.657393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9077e589-147c-422f-a1fb-cef1eec3253b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.157552 Oct 06 08:14:51.657961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 133/251] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:51 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:52.684493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:52.685087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:52.691533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:52.692010 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:52.692436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:52.693111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:52.693553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:52.693966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:52.698044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:52.831954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:52.841676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9c6f57df-a744-4135-927a-e1dd316ffc05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.161623 Oct 06 08:14:52.842263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 119/252] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:52 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:53.864433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:53.865037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:53.871244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:53.871763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:53.872196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:53.872881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:53.873327 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:53.873746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:54.005581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:54.013916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-786f6278-6f97-45fe-9487-ca218ab4e3e0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.153407 Oct 06 08:14:54.014485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 134/253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:53 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:55.036524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:55.037109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:55.044854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:55.045354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:55.045786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:55.046479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:55.046928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:55.047389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:55.185468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:55.193223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0b118bfa-1a0a-448a-b3ab-15ebebafb642 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.160663 Oct 06 08:14:55.193784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 120/254] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:55 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:56.215908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:56.216518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:56.218896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=99 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:14:56.223848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:56.224333 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:56.224767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:56.225456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:56.225933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:56.226354 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:56.361579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:56.370286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-478ea33e-6010-4f6f-a5e4-a957ee723d24 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.158013 Oct 06 08:14:56.370590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 135/255] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:56 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:57.393499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:57.394195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:57.401351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:57.401835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:57.402271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:57.402983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:57.403465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:57.404027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:57.546925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:57.554845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4703d4f7-bcb8-4c85-a18b-796a733b4c5d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.165195 Oct 06 08:14:57.555433 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 121/256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:57 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:58.577959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:58.578482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:58.584452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:58.584920 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:58.585347 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:58.586019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:58.586490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:58.586906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:58.720550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:58.729913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cf062d77-e699-4f0e-a34b-4d9b6e7df91f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.154803 Oct 06 08:14:58.730541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 136/257] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:58 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:14:59.489458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:59.490067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:59.498154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.498890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.499266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.500311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.500864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.501218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.531569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:14:59.756519 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:59.756519 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:59.760280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.760544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.761007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.761717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.762295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.762556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.867460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fec19d3b-223e-4c51-85aa-f07dde24cfe4 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 204 len: 0 microversion: 2.1 time: 0.381502 Oct 06 08:14:59.868155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 122/258] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:14:59 2022] DELETE /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:14:59.876524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:14:59.877209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:14:59.883178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.883659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.884084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.884861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:14:59.885303 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:14:59.885713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:14:59.901423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:14:59.909777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-807979f5-e4cb-45c1-899a-367e795fc44c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.161162 Oct 06 08:14:59.910350 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 137/259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:59 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:00.034386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:00.043792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1bd0c109-26f3-438e-b060-4e389c3f2a12 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.171198 Oct 06 08:15:00.044382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 123/260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:14:59 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:00.933864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:00.934477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:00.940457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:00.940942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:00.941380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:00.942068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:00.942525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:00.942966 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:01.066578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:01.067324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:01.069175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:01.074516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:01.078263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:01.078263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:01.078263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:01.078263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:01.078570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:01.078667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-45b9c72f-c4e1-43fa-a371-e9439b0ae43c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.147434 Oct 06 08:15:01.078667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 138/261] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:00 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:01.206562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:01.215354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d8f675e2-c8e9-4be1-9aac-058f8a647f21 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.152693 Oct 06 08:15:01.215922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 124/262] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:01 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:02.100738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:02.101370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:02.108167 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:02.108658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:02.109094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:02.109785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:02.110243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:02.110665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:02.237891 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:02.238476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:02.239123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:02.245344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:02.245818 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:02.246243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:02.246922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:02.247390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:02.247536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae559dda-268c-4b1c-96f9-3632fdf21084 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.150675 Oct 06 08:15:02.247804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:02.248120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 139/263] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:02 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:02.374661 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:02.383127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1bf8e3a8-0b14-4fa5-a72b-8a65e5e07036 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.149128 Oct 06 08:15:02.383692 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 125/264] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:02 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:03.271734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:03.272348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:03.278811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:03.279312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:03.279742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:03.280415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:03.280858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:03.281276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:03.406546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:03.407077 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:03.412027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:03.413442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:03.413926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:03.414378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:03.415084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:03.415536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:03.415960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:03.420656 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f9207d6f-84d1-4f8a-82b1-8b53c0466108 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.152725 Oct 06 08:15:03.421237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 140/265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:03 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:03.551321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:03.559720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d628d1ea-5038-483c-b7fc-16faf0e7d69f tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.157912 Oct 06 08:15:03.560407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 126/266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:03 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:04.443844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:04.444457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:04.450513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:04.451028 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:04.451468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:04.452151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:04.452603 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:04.453027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:04.576346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:04.581615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:04.582252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:04.584523 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-423a4274-f56a-45fb-b384-2304adac064e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.144486 Oct 06 08:15:04.585105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 141/267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:04 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:04.588722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:04.589745 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:04.590350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:04.591140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:04.591596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:04.592018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:04.723915 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:04.733906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ea558c6b-686e-4e85-9bef-efeada5fd1ec tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.156212 Oct 06 08:15:04.734622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 127/268] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:04 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:05.608417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:05.609018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:05.614792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:05.615304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:05.615736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:05.616414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:05.616858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:05.617275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:05.754824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:05.757747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:05.758436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:05.763887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ac64778f-4efc-42be-95d5-fc1b9c2e5ea5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.159288 Oct 06 08:15:05.764477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 142/269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:05 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:05.767361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:05.767933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:05.768463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:05.769277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:05.769859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:05.770417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:05.925812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:05.936638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b44f4998-ad96-4382-ae28-19580acac920 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.182911 Oct 06 08:15:05.939109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 128/270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:05 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:06.787106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:06.787718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:06.793913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:06.794401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:06.794855 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:06.795574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:06.796032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:06.796453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:06.800561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:06.968198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:06.968840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:06.985060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:06.985563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:06.991459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:06.992213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:06.992677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:06.993266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:07.043746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:07.051831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e2126046-a09a-463c-a221-70c379e8b191 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.268620 Oct 06 08:15:07.052416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 143/271] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:06 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:07.162253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:07.173089 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-883665bc-57e5-4192-9f0a-748e8ecae867 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1553 microversion: 2.1 time: 0.214352 Oct 06 08:15:07.173680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 129/272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:06 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:07.723233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50ee3315-881b-40ca-b2c8-f48304b28c26", "name": "network-vif-deleted", "tag": "dc66c46a-ad12-49b0-9b85-c22aece7728d"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:15:07.733228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:07.733978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:07.734796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:07.747713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] Creating event network-vif-deleted:dc66c46a-ad12-49b0-9b85-c22aece7728d for instance 50ee3315-881b-40ca-b2c8-f48304b28c26 on hv-cinder-86021 Oct 06 08:15:07.752798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-2c01d4a0-ea31-4680-a7a2-b093db8b4d80 req-6078e73f-0343-41e0-9770-f94780c8956a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036992 Oct 06 08:15:07.753739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 144/273] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:15:08.076236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:08.076847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:08.083332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:08.083819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:08.084255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:08.084947 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:08.085404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:08.085842 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:08.196450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:08.197302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:08.203642 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:08.204307 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:08.204736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:08.205791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:08.206252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:08.206720 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:08.243675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:08.252444 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ce504a78-0ae7-4c8b-8d78-4e4ebcea0958 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.180253 Oct 06 08:15:08.253017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 130/274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:08 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:08.270678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:08.279751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cbeed690-24a0-4a69-9c97-37ae6a24f37a tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1511 microversion: 2.1 time: 0.087509 Oct 06 08:15:08.280322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 145/275] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:08 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:09.276469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:09.277896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:09.284311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:09.284721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:09.285147 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:09.285823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:09.286267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:09.286704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:09.302969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:09.303766 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:09.310738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:09.311704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:09.312379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:09.313620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:09.314322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:09.314979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:09.385578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:09.394558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6b84657b-ab6e-4ccb-93b3-dac9c8882edf tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1511 microversion: 2.1 time: 0.095432 Oct 06 08:15:09.395424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 146/276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:09 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1511 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:09.445937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:09.454724 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-02a5a4be-ef6c-4b1b-bcf4-28434ce59135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.182219 Oct 06 08:15:09.455323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 131/277] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:09 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:10.418069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:10.418687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:10.424427 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:10.424935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:10.425365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:10.426039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:10.426485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:10.426899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:10.477818 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:10.478517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:10.485806 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:10.486369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:10.486878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:10.487244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:10.487739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:10.488271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:10.488782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:10.496022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0a5e8ba5-8624-4770-80f4-1936ba8cfe7b tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1346 microversion: 2.1 time: 0.082240 Oct 06 08:15:10.496790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 147/278] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:10 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:10.620005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:10.632436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a889f35-d081-4d97-a336-e1a2425cac92 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.154376 Oct 06 08:15:10.632436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 132/279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:10 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:11.518811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:11.519455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:11.525351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:11.525830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:11.526303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:11.527010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:11.527465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:11.527894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:11.591095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:11.599341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-786f8d12-4b61-47e6-9513-c734a51fa715 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1346 microversion: 2.1 time: 0.084289 Oct 06 08:15:11.599904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 148/280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:11 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:11.652721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:11.653314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:11.659702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:11.660177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:11.660602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:11.661276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:11.661721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:11.662136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:11.794693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:11.802411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-78f18270-d0c2-47a7-9155-311503f03dae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.153676 Oct 06 08:15:11.802993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 133/281] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:11 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:12.622971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:12.623558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:12.629721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:12.630201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:12.630632 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:12.631382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:12.631785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:12.632245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:12.662530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:12.663026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:12.663452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:12.663889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lazy-loading 'fault' on Instance uuid 50ee3315-881b-40ca-b2c8-f48304b28c26 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:15:12.709278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9427fe8723fb4b298b42106a862a798f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c1a79616054d3c988fac816f4acc8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:12.721410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8770e0a3-f28f-4017-96f1-bcc43d1f7f2c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 200 len: 1351 microversion: 2.1 time: 0.102040 Oct 06 08:15:12.721410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 149/282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:12 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:12.827769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:12.828522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:12.834997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:12.835578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:12.836118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:12.836810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:12.837262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:12.837684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:12.843145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:12.973423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:12.984200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fe609a43-dcdf-477c-956b-f2561eac7bc6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.162299 Oct 06 08:15:12.984781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 134/283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:12 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:13.749187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:13.758408 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:13.760432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:13.761410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:13.761992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:13.762682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:13.763281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:13.763711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:13.778262 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] HTTP exception thrown: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Request method failure captured: Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 HTTP/1.1 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4x9f5Gw-kAjJjSWzt1GTzkveftjhXgGgXbV7HMATg6vxnBE99bop96buMj7gRb8PBuRUNRsLo3NgDaWYMmRvH2CV1SVWYiLifhZy3VI5bB8df4b3ZSE25KOZuG7EorBwSsF9f8TDUqcWIFMmzYuC4X1ZU1s642wUhGlcjpb-D6R88 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:15:13.783861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9427fe8723fb4b298b42106a862a798f Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.785224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '50ee3315-881b-40ca-b2c8-f48304b28c26'} Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:15:13.785973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.787162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.788238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Returning 404 to user: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:15:13.788238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4db699b6-394c-403a-ad69-e01ed73f07b6 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 404 len: 111 microversion: 2.1 time: 0.040944 Oct 06 08:15:13.788238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 150/284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:13 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:15:13.909668 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:13.912036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:13.914301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:13.919722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:13.920337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:13.920823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:13.921518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:13.922085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:13.933476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:13.948885 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] HTTP exception thrown: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Request method failure captured: Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26/os-volume_attachments HTTP/1.1 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4x9f5Gw-kAjJjSWzt1GTzkveftjhXgGgXbV7HMATg6vxnBE99bop96buMj7gRb8PBuRUNRsLo3NgDaWYMmRvH2CV1SVWYiLifhZy3VI5bB8df4b3ZSE25KOZuG7EorBwSsF9f8TDUqcWIFMmzYuC4X1ZU1s642wUhGlcjpb-D6R88 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:15:13.960053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9427fe8723fb4b298b42106a862a798f Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.961631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'server_id': '50ee3315-881b-40ca-b2c8-f48304b28c26'} Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:15:13.962440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:13.964291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:13.965683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Returning 404 to user: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:15:13.965683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-33f9113c-06ea-4239-add7-aff0c90d253c tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.057462 Oct 06 08:15:13.965683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 135/285] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:15:13 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:15:14.019107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:14.019107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:14.027018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:14.027018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:14.027018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:14.027018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:14.027590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:14.027940 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:14.200210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:14.208407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a6812a6c-160e-412f-ae46-cb7a1815ff6a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.204485 Oct 06 08:15:14.209091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 151/286] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:14 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:15.233811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:15.234412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:15.241415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.241893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.242625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.243257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.243906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.244462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.383281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:15.383820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:15.390711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.391546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.392255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.392607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:15.393095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.393616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.394106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.400980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6b0a08b3-9c15-4f72-adc2-df4085d58369 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.172048 Oct 06 08:15:15.402111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 136/287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:15 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:15.409620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] HTTP exception thrown: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Request method failure captured: Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: DELETE /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 HTTP/1.1 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4x9f5Gw-kAjJjSWzt1GTzkveftjhXgGgXbV7HMATg6vxnBE99bop96buMj7gRb8PBuRUNRsLo3NgDaWYMmRvH2CV1SVWYiLifhZy3VI5bB8df4b3ZSE25KOZuG7EorBwSsF9f8TDUqcWIFMmzYuC4X1ZU1s642wUhGlcjpb-D6R88 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:15:15.411485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9427fe8723fb4b298b42106a862a798f Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.413504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '50ee3315-881b-40ca-b2c8-f48304b28c26'} Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:15:15.414531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.416032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.418768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Returning 404 to user: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:15:15.419977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-69f4d62b-4f4d-49b3-bb1e-f32572c118ff tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 404 len: 111 microversion: 2.1 time: 0.040652 Oct 06 08:15:15.422986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 152/288] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:15:15 2022] DELETE /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:15:15.429581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:15.430195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] [instance: 50ee3315-881b-40ca-b2c8-f48304b28c26] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:15.437694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.438218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.438624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.439356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:15.439810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:15.440232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:15.455854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] HTTP exception thrown: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Request method failure captured: Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 HTTP/1.1 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4x9f5Gw-kAjJjSWzt1GTzkveftjhXgGgXbV7HMATg6vxnBE99bop96buMj7gRb8PBuRUNRsLo3NgDaWYMmRvH2CV1SVWYiLifhZy3VI5bB8df4b3ZSE25KOZuG7EorBwSsF9f8TDUqcWIFMmzYuC4X1ZU1s642wUhGlcjpb-D6R88 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:15:15.459635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/37c1a79616054d3c988fac816f4acc8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 37c1a79616054d3c988fac816f4acc8b Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-DeleteServersTestJSON-1856923327 Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9427fe8723fb4b298b42106a862a798f Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-DeleteServersTestJSON-1856923327-project Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.460909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '50ee3315-881b-40ca-b2c8-f48304b28c26'} Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:15:15.461576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. Oct 06 08:15:15.462621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:15:15.465602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] Returning 404 to user: Instance 50ee3315-881b-40ca-b2c8-f48304b28c26 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:15:15.465602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7c1597ae-945a-4c01-891c-426c85beccc3 tempest-DeleteServersTestJSON-1856923327 tempest-DeleteServersTestJSON-1856923327-project] 10.222.0.30 "GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26" status: 404 len: 111 microversion: 2.1 time: 0.033865 Oct 06 08:15:15.465602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 137/289] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:15 2022] GET /compute/v2.1/servers/50ee3315-881b-40ca-b2c8-f48304b28c26 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:15:16.431273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:16.433196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:16.439796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:16.440633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:16.441269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:16.442180 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:16.443000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:16.450261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:16.641092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:16.659084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ebca805c-eee0-4809-b97d-48572d72f472 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.222765 Oct 06 08:15:16.659084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 153/290] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:16 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:17.676098 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:17.677919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:17.687264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:17.688582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:17.689191 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:17.690484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:17.691131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:17.692022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:17.934274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:17.945278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-53fae10d-b6c2-4bf4-8a73-b76aad9a1b44 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.271702 Oct 06 08:15:17.946468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 138/291] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:17 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:18.973039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:18.974267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:18.996976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:18.997780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:18.998231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:18.998969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:19.002151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:19.002151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:19.294653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:19.302714 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-58a02b85-c182-40db-a9b7-00f1d83985a4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.335742 Oct 06 08:15:19.323092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 154/292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:18 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:20.327952 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:20.328516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:20.337960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:20.339950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:20.340493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:20.341343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:20.341936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:20.342470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:20.840670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:20.852923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-acd54172-ad6d-4515-938f-e1bb2ebf7fa1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.530680 Oct 06 08:15:20.856808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 139/293] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:20 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:21.887200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:21.888467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:21.898046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:21.898546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:21.899024 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:21.900794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:21.902601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:21.903692 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:22.164376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:22.174483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-90e59a8b-c648-452a-b08d-fee806bf7937 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.292662 Oct 06 08:15:22.175397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 155/294] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:21 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:23.207860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:23.209338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:23.222095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:23.222905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:23.223726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:23.225053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:23.225554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:23.225978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:23.418509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:23.443826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cf89f5b5-5f27-4654-b21a-ce45b6dc0bc8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.227514 Oct 06 08:15:23.454162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 140/295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:23 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:24.458278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:24.458885 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:24.465618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:24.466108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:24.466547 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:24.467290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:24.467749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:24.468194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:24.608952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:24.617261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4fc4e29a-8fe6-4e4b-9cbb-400614dcb877 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.162759 Oct 06 08:15:24.618505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 156/296] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:24 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:25.641757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:25.643116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:25.650499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:25.651532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:25.652255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:25.655051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:25.655747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:25.656347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:25.949887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:25.972511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d045cd67-7ff0-49e6-b282-af0916ca00eb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.330928 Oct 06 08:15:25.973326 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 141/297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:25 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:26.997956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:26.998574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:27.001138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=46 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:27.014201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:27.019120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:27.019850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:27.020789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:27.021430 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:27.022046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:27.219764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:27.231361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-91435a12-02ec-4d6a-8c5d-910585608709 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.238608 Oct 06 08:15:27.232679 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 157/298] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:26 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:28.257082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:28.258592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:28.274279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:28.275156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:28.276043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:28.277045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:28.277224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:28.277817 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:28.749094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:28.760461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-026f480e-a7d1-4aaf-96d6-82487d029060 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.507871 Oct 06 08:15:28.761294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 142/299] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:28 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:29.791016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:29.792586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:29.799659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:29.800163 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:29.800600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:29.801296 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:29.801926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:29.802508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:30.061045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:30.069465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8850aac5-5978-4f7f-8374-29c87802db39 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.284423 Oct 06 08:15:30.070140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 158/300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:29 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:31.094496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:31.095136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:31.106235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:31.111677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:31.112817 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:31.114073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:31.114619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:31.115290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:31.372825 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:31.389038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3ad25592-8d85-4bbb-b322-f9687e3fc351 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.300463 Oct 06 08:15:31.390795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 143/301] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:31 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:32.417461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:32.418088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:32.425233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:32.425962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:32.426391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:32.427378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:32.427832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:32.428415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:32.579953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:32.587920 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-27c306b2-9911-442f-b534-521c062f9f76 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.175721 Oct 06 08:15:32.589174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 159/302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:32 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:33.611360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:33.612701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:33.620164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:33.621169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:33.621751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:33.622552 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:33.623096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:33.623751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:33.783315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:33.800626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a93c2b1c-bd26-4d16-b5d0-e38981d8340b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1519 microversion: 2.1 time: 0.191761 Oct 06 08:15:33.801428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 144/303] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:33 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:34.824967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:34.826379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:34.841583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:34.842181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:34.842689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:34.843496 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:34.844183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:34.844816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:35.040945 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:35.052268 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7a6ce4cb-e5c8-441f-b14a-3ced12e1e2e2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1499 microversion: 2.1 time: 0.231424 Oct 06 08:15:35.053923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 160/304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:34 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:35.077278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:35.077886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:35.099861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:35.099861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:35.100237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:35.101162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:35.101589 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:35.102452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:35.429846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:35.441449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1539dc21-c53d-4334-acc6-f50598d97ab5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1513 microversion: 2.1 time: 0.368877 Oct 06 08:15:35.455194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 145/305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:35 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:38.662925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:15:38.665905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:38.673415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:38.674170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:38.674830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:38.675832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:38.676500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:38.677112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:38.681418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:38.706114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'flavor' on Instance uuid e1084773-96dd-49ad-b6a7-11e7f90ba5b1 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:15:39.184200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-313211c1-97ed-40dd-bafb-27689a324bd9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/action" status: 200 len: 32 microversion: 2.1 time: 0.520209 Oct 06 08:15:39.185304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 161/306] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:15:38 2022] POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:15:39.195277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:39.195885 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:39.210983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:39.211648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:39.213695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:39.213695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:39.215111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:39.215961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:39.406439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:39.417866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e9e46c04-b509-4a7b-bae4-4f7328e233e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.224451 Oct 06 08:15:39.417866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 146/307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:39 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:40.443320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:40.444328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:40.455586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:40.456927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:40.457735 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:40.459211 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:40.462307 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:40.463011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:40.706577 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:40.721380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-72fa9148-6030-464c-8001-f1ee915d9fed tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.283476 Oct 06 08:15:40.722511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 162/308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:40 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:41.751223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:41.752610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:41.761005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:41.762335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:41.763016 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:41.764680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:41.765858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:41.766473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:41.934407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:41.948104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-58a76266-95d2-47f1-b280-10f8335758b4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.200148 Oct 06 08:15:41.962697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 147/309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:41 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:42.987194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:42.989456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:43.008625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:43.011540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:43.012155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:43.013026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:43.013624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:43.014216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:43.251734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:43.261725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d57e5f74-c80e-4183-a534-b54484418a3c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.288692 Oct 06 08:15:43.263041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 163/310] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:42 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:44.293113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:44.293735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:44.305155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:44.307898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:44.308530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:44.309431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:44.310050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:44.310657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:44.325155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=75 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:44.493803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:44.502278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-60090457-a6d2-46a0-a8ba-4080ec69ddac tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.216282 Oct 06 08:15:44.502840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 148/311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:44 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:45.527390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:45.528373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:45.537752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:45.540659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:45.542492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:45.545604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:45.546655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:45.548640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:46.028833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:46.036449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8498e59c-0630-4f2b-8d4f-7005537e34c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.513805 Oct 06 08:15:46.045469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 164/312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:45 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:46.313424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-11038ebd-84dc-429f-ba16-f954c0b7d95c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'create', calling method: .version_select at 0x7f923c044670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1602971688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIgfoNMR0UVgp3Lho3aa1nbWSFDorL+AAU+kns5Eq3g7EMUHNxkhoFsknXhE0Eek0wgQONyLhkZms6ICiuz5jShT46C9qvmFi2mbWZ3O5ZtWTZfdw8mq9sYbtbk5n3Z8Q=="}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:15:46.325128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=28 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:46.336078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-11038ebd-84dc-429f-ba16-f954c0b7d95c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Getting quotas for project 9b4d6dd628464c05b707fee1dd32f04a. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:15:46.340297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-11038ebd-84dc-429f-ba16-f954c0b7d95c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Getting quotas for user e767c7081875428382af11d1ff475a20 and project 9b4d6dd628464c05b707fee1dd32f04a. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:15:46.532493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-11038ebd-84dc-429f-ba16-f954c0b7d95c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.223383 Oct 06 08:15:46.533112 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 149/313] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:15:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:15:46.666331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1156695370", "imageRef": "60a084e3-e2b5-40ea-a43e-ba35ec108a22", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1602971688", "networks": [{"uuid": "0ee60ba1-461e-428d-8864-34c83f7d22f7"}]}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:15:46.725592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] validate_networks() for [('0ee60ba1-461e-428d-8864-34c83f7d22f7', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:15:47.067499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:47.067499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:47.068238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:47.068730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:47.069173 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:47.069869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:47.070327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:47.070755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:47.166191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:15:47.166911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:15:47.167800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:15:47.168500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:15:47.169199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:15:47.193260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:47.193908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:47.195909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:47.197004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:47.199038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:47.199622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:47.239707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Getting quotas for project 9b4d6dd628464c05b707fee1dd32f04a. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:15:47.245856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Getting quotas for user e767c7081875428382af11d1ff475a20 and project 9b4d6dd628464c05b707fee1dd32f04a. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:15:47.261650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:15:47.268986 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:47.276398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60a084e3-e2b5-40ea-a43e-ba35ec108a22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:15:47.278122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a26f6b42-4693-4b9a-b9f6-9f0a78882004 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.221649 Oct 06 08:15:47.279543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 150/314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:47 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:47.448472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-924c1a94-4d03-42a5-a7b4-c4d2460898a6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.788562 Oct 06 08:15:47.449395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 165/315] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:15:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:15:47.459919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fb229c1b-9da6-416f-b72d-42a7ae88a2e2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:47.460517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fb229c1b-9da6-416f-b72d-42a7ae88a2e2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:47.528324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fb229c1b-9da6-416f-b72d-42a7ae88a2e2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:47.536886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fb229c1b-9da6-416f-b72d-42a7ae88a2e2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1259 microversion: 2.1 time: 0.080781 Oct 06 08:15:47.537473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 151/316] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:47 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:48.302300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:48.303023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:48.310875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:48.311499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:48.311997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:48.312874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:48.313478 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:48.314058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:48.457456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:48.467975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b56daac5-d81d-43d9-b85b-1cd89b1bb9c1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.169811 Oct 06 08:15:48.480744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 166/317] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:48 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:48.562537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bc391c1a-eaad-4cca-a11f-2a7a497b65c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:48.563865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bc391c1a-eaad-4cca-a11f-2a7a497b65c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:48.633093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bc391c1a-eaad-4cca-a11f-2a7a497b65c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:48.640004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bc391c1a-eaad-4cca-a11f-2a7a497b65c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1259 microversion: 2.1 time: 0.083287 Oct 06 08:15:48.640799 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 152/318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:48 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1259 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:49.491217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:49.491852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:49.499015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:49.501292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:49.501292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:49.501292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:49.501292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:49.501628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:49.658890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:49.663145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:49.663762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:49.679773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:49.679773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:49.679773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:49.679773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:49.680056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:49.680056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:49.681588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4c6b28d5-dec0-4087-a5e9-44e43a216f53 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.194031 Oct 06 08:15:49.683147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 167/319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:49 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:49.760175 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:49.768316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-344180d7-af29-4b16-bf22-0eaf5205acb8 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1255 microversion: 2.1 time: 0.108980 Oct 06 08:15:49.768887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 153/320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:49 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1255 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:50.710722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:50.712220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:50.722223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:50.722716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:50.723371 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:50.724260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:50.724711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:50.725292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:50.791880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:50.792829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:50.799352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:50.799927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:50.800509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:50.801277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:50.801805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:50.802295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:50.865855 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:50.874428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7b1c08c2-cf9d-4527-a6ae-45ab2e022f64 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1319 microversion: 2.1 time: 0.087101 Oct 06 08:15:50.875013 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 154/321] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:50 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1319 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:50.991573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:51.000530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-535863fb-b4db-4d1f-9279-f5e39b3e71dc tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.297180 Oct 06 08:15:51.001098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 168/322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:50 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:51.899625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:51.901045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:51.908025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:51.908512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:51.912256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:51.912256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:51.912256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:51.912256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:52.037482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:52.038210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:52.048609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:52.049331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:52.050186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:52.051364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:52.051975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:52.052558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:52.069080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:52.078096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-382b45b5-2800-4a94-b929-e163c8d2bcc2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.182246 Oct 06 08:15:52.087403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 155/323] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:51 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:52.208786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:52.217244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-81dbe9c2-175d-45f1-9dc8-bbd47fd3e784 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.196816 Oct 06 08:15:52.217812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 169/324] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:52 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:15:53.102257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:53.102858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:53.109831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:53.110346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:53.117304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:53.117304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:53.117304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:53.117304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:53.242389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:53.244579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:53.252203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:53.252999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:53.253601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:53.255657 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:53.256128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:53.256558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:53.383584 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:53.397105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-65c42253-eee8-4d5c-9282-615394c55d9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.297604 Oct 06 08:15:53.398059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 156/325] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:53 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:53.676972 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:53.687131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-37a2468a-9ccc-4091-9081-510463259d8b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.449467 Oct 06 08:15:53.688109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 170/326] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:53 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:53.877781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:15:53.893250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:53.897442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:53.898130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:53.915232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] Creating event network-changed:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:15:53.921274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-9e203410-27f7-4cfc-8b91-e74cbb8ebf8c req-dfb99a60-ac89-4ccc-ac21-877efd1709c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047092 Oct 06 08:15:53.922386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 157/327] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:15:54.422846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:54.423575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:54.429690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:54.430261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:54.434589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:54.435847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:54.436587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:54.437004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:54.611249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:54.619301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cc02b66d-e8ac-4223-9773-3cbeb35d098c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.200172 Oct 06 08:15:54.619885 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 171/328] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:54 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:54.717996 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:54.724465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:54.730821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:54.731945 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:54.732481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:54.733341 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:54.734696 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:54.735259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:54.878725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:54.886665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ce0f95fe-bda2-41ef-9c6e-6dd96767cea8 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.176455 Oct 06 08:15:54.887292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 158/329] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:54 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:55.644636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:55.645289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:55.652092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:55.657617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:55.657617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:55.657617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:55.657617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:55.657955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:55.823113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:55.831235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2a26b059-3aa8-4112-8393-2af36d1973db tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.190485 Oct 06 08:15:55.831811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 172/330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:55 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:55.908824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:55.910302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:55.919879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:55.920361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:55.920793 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:55.921498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:55.922000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:55.922399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:56.085252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:56.093859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1cf9b59d-c81b-4c4b-ab3a-ab3556bf9295 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.188907 Oct 06 08:15:56.094419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 159/331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:55 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:56.856764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:56.857373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:56.863245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:56.863729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:56.864164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:56.864848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:56.865361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:56.865803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:57.051321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:57.061405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-63f6c2a8-cc34-476f-8fa1-4a56d5d058b9 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.208707 Oct 06 08:15:57.062329 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 173/332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:56 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:57.118027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:57.118627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:57.125902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:57.126383 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:57.126815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:57.127919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:57.128369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:57.128789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:57.277184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:57.286611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f4b2cc38-0f08-47df-a836-032f2ff0aea3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.172252 Oct 06 08:15:57.287237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 160/333] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:57 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:58.085164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=6 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:58.135290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:58.135802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:58.135802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:58.135802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:58.135802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:58.260944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:58.269637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fd9ed791-0ee0-4d8d-9262-0a6d5e6b8f0e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.188399 Oct 06 08:15:58.270241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 174/334] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:58 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:58.310309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:58.311004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:58.317404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:58.317949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:58.318402 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:58.319123 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:58.319567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:58.319985 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:58.457237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:58.465566 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-60a418b9-8830-49cd-992d-29ef8c6f4f5e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.159796 Oct 06 08:15:58.466309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 161/335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:58 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:59.296027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:59.297252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:59.315402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:59.316278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:59.316939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:59.317887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:59.318557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:59.319239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:59.494660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:15:59.494660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:15:59.506197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=8 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:15:59.508401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:59.513617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:59.514499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:59.516514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:15:59.521303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:59.521959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:15:59.521959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:15:59.530266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6de08196-8dec-46c8-8436-796fea10786f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.239579 Oct 06 08:15:59.531330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 175/336] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:59 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:15:59.660587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:15:59.669227 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e92033c5-68e4-47f1-8e81-73153f1c0b55 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.184393 Oct 06 08:15:59.669791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 162/337] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:15:59 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:00.553746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:00.554429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:00.560830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:00.561342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:00.561770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:00.562482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:00.562981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:00.563400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:00.578195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:00.691125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:00.692954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:00.693567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:00.698694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-60ae96d3-1867-4bcf-8488-e60059ebc7fc tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.149081 Oct 06 08:16:00.699500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 176/338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:00 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:00.700470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:00.700967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:00.701405 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:00.702134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:00.702598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:00.703053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:00.833620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:00.842111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b2ebe17-3772-49dc-aa77-2a942e47c115 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.153352 Oct 06 08:16:00.842678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 163/339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:00 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:01.722233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:01.722988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:01.733442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:01.733864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:01.734376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:01.735138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:01.735589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:01.736022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:01.865695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:01.866693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:01.874546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:01.875069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:01.875509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:01.876212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:01.877414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:01.877890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:01.880544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:01.896123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4e3323b0-fa5b-4143-b09e-5938638a7010 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.177902 Oct 06 08:16:01.897352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 177/340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:01 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:02.039545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:02.047714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-264eca7f-0f55-44e3-9049-92226cda3df4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.186119 Oct 06 08:16:02.048286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 164/341] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:01 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:02.923204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:02.923814 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:02.929745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:02.930223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:02.930652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:02.931369 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:02.931888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:02.932483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:03.075217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:03.075922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:03.083130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:03.084099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:03.084739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:03.085636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:03.086293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:03.087387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:03.091322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:03.110097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4e9d0459-2769-43d3-872c-1c84371c5884 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.191977 Oct 06 08:16:03.110686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 178/342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:02 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:03.248732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:03.256752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e9e8d2ce-639f-407a-b316-1e01f8b65ddf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.186908 Oct 06 08:16:03.257343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 165/343] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:03 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:03.384867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2144213841", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "networks": [{"uuid": "13ee70c1-b283-4e47-bd71-1df0f98884c9"}]}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:03.437963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] validate_networks() for [('13ee70c1-b283-4e47-bd71-1df0f98884c9', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:16:03.891512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:16:03.891512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:16:03.891512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:16:03.891512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:16:03.891512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:16:03.893000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:03.893000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:03.893000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:03.893000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:03.893332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:03.893332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:03.893332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Getting quotas for project 141863eb21404f229b8d624af2ff6743. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:16:03.893332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Getting quotas for user fff5a88cba04475c9a0142156a2269f0 and project 141863eb21404f229b8d624af2ff6743. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:16:03.893664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:16:03.893664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:16:04.134910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:04.135729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:04.142596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:04.143135 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:04.143774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:04.144471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:04.144921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:04.145336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:04.202358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e1232db3-c8e1-4c64-99e8-edbc6200d937 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821322 Oct 06 08:16:04.211676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 179/344] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:16:04.221312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-285bfaf1-a82c-4c9a-bf1a-82d3de78157a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:04.222499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-285bfaf1-a82c-4c9a-bf1a-82d3de78157a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:04.295299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-285bfaf1-a82c-4c9a-bf1a-82d3de78157a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:04.318621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-285bfaf1-a82c-4c9a-bf1a-82d3de78157a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1219 microversion: 2.1 time: 0.092734 Oct 06 08:16:04.320738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 180/345] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:04 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:04.340121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:04.342988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:04.355613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:04.358770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:04.360050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:04.360916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:04.363309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:04.363951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:04.500114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:04.514281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e6c822dd-fb81-466c-b2d7-22454cc4125e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.384612 Oct 06 08:16:04.527462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 166/346] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:04 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:04.578602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:04.580761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-85897161-4b18-4a4d-90a7-705bb9bb59af tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.258413 Oct 06 08:16:04.581690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 181/347] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:04 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:05.349321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6a8165df-bfc9-4620-9a8f-b927dac59158 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:05.350343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6a8165df-bfc9-4620-9a8f-b927dac59158 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:05.408413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6a8165df-bfc9-4620-9a8f-b927dac59158 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:05.416132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6a8165df-bfc9-4620-9a8f-b927dac59158 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1219 microversion: 2.1 time: 0.074660 Oct 06 08:16:05.416943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 167/348] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:05 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:05.549718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:05.550479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:05.565602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:05.566099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:05.566535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:05.567276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:05.572851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:05.572851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:05.607016 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:05.617922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:05.625640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:05.626403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:05.627259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:05.628143 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:05.628752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:05.629333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:05.720061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:05.743069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c9ec0418-3457-40b7-95f8-5cdff30a6597 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.182708 Oct 06 08:16:05.771137 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 182/349] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:05 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:05.796430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:05.804807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-39f66f63-95d3-463c-996f-203de71f9e1c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.202425 Oct 06 08:16:05.805532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 168/350] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:05 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:06.442525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:06.443069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:06.449696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.450176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.450601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.451335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.451768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.452276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.515385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:06.523486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b89ff91e-8c46-470a-aec8-98b5cafc2395 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1223 microversion: 2.1 time: 0.085291 Oct 06 08:16:06.524061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 183/351] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:06 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:06.776896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:06.777648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:06.784896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.785381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.785815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.786495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.787043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.917970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.917970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:06.918690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:06.918690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:06.918690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.918690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.919604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.919604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:06.919604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:06.919604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:06.920370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:06.926383 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-148aaec1-4c37-451a-a113-837e632d5a2d tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.153393 Oct 06 08:16:06.926961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 169/352] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:06 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:06.970257 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:06.979153 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5be7d87b-7143-48f7-b99b-1bec4439a654 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.153641 Oct 06 08:16:06.979847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 184/353] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:06 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:07.549094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:07.549704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:07.556049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:07.556537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:07.556975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:07.557666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:07.558120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:07.558621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:07.623033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:07.632648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e1258dd6-fee9-43c4-a0ad-da86b3aa6d5f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1223 microversion: 2.1 time: 0.087622 Oct 06 08:16:07.633326 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 170/354] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:07 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:07.949963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:07.950605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:07.956959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:07.959278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:07.959278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:07.959278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:07.959278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:07.959781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:08.002580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:08.003318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:08.011468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:08.012086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:08.012539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:08.013248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:08.013705 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:08.014137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:08.104426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:08.112762 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-81aff3af-c558-4c44-a7cf-0b3f8a629353 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.167298 Oct 06 08:16:08.113550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 185/355] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:07 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:08.164249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:08.173407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d77d6b4a-d034-4c7e-8ec2-696442f58d33 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.174786 Oct 06 08:16:08.174031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 171/356] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:07 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:08.656986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:08.657590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:08.663500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:08.663978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:08.664409 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:08.665099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:08.665550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:08.666533 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:08.736524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:08.750643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a3f011cb-364c-4121-8f04-c931c3f906fc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1223 microversion: 2.1 time: 0.091715 Oct 06 08:16:08.750643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 186/357] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:08 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:09.139869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:09.141489 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:09.153254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.156127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.156127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.156127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.156127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.157113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.199768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:09.200378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:09.207028 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.207520 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.208119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.209236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.209841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.212470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.313691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:09.323308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f18bb7ee-8456-471e-8178-8b77cc48aefe tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.189595 Oct 06 08:16:09.324082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 172/358] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:09 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:09.373921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:09.382096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7f893ff3-a709-47b6-a4dd-5472d13d16f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.187942 Oct 06 08:16:09.382654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 187/359] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:09 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:09.769176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:09.770071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:09.776362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.776859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.777293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.778004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:09.778456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:09.778880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:09.843829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:09.851583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c6328085-8a56-4e45-954f-a2b583acf1b2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1215 microversion: 2.1 time: 0.086366 Oct 06 08:16:09.852164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 173/360] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:09 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:10.352602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:10.353279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.359468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.359952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.360389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.361078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.361533 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.362084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.405681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:10.406397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.413162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.413759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.414396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.415054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.415580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.416208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.520465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:10.529941 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d86fe1d1-2175-475d-9c05-8f610eed1951 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.181243 Oct 06 08:16:10.530900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 188/361] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:10 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:10.570036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:10.579236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6a2a9484-ca29-4beb-868d-0aadc4343e18 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1499 microversion: 2.1 time: 0.177334 Oct 06 08:16:10.579805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 174/362] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:10 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1499 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:10.602528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a524bc9-fdf1-4a7a-be41-2e9790a4f099"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:10.605382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.611958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.612447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.613689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.613689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.614044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.614472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.638653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] HTTP exception thrown: Cannot 'attach_volume' instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 while it is in vm_state rescued Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Request method failure captured: Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/os-volume_attachments HTTP/1.1 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 74 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44j6z1K7FntfimuG7BkJKrChOjKGGCi5vuzxL-ui6Bp-YO32gSJx4zy2G39zbq51zSDmHHFfcfrB03Iy_d74SNl-XapWbJ52_BbNogPBAS8audB8QW9qei9izScHPCOpnZFm0XPfi6jMi6024YJFt72cKBONXVQcdR9Hvx2yjMP3w Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:16:10.640638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 85bdfc4b6ad443d68ebc0d6932ccad66 Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {"volumeAttachment": {"volumeId": "6a524bc9-fdf1-4a7a-be41-2e9790a4f099"}} Oct 06 08:16:10.642273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Cannot 'attach_volume' instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 while it is in vm_state rescued Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'server_id': 'e1084773-96dd-49ad-b6a7-11e7f90ba5b1', 'body': {'volumeAttachment': {'volumeId': '6a524bc9-fdf1-4a7a-be41-2e9790a4f099'}}} Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:16:10.650014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 while it is in vm_state rescued Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:16:10.652087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 while it is in vm_state rescued Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Returning 409 to user: Cannot 'attach_volume' instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 while it is in vm_state rescued {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f714d242-39c9-4b39-b959-3acdbd623c7d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043689 Oct 06 08:16:10.653396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 189/363] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:16:10 2022] POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 08:16:10.653934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:10.653934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.659039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.659530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.659967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.660696 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.661153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.661580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.876107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:10.876621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.884219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.885261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.885685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.886382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.886825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.887317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.894110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f9ca8da0-6b55-44a1-8973-02357f9a62bd tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.245995 Oct 06 08:16:10.895049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 175/364] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:16:10 2022] POST /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:16:10.905735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:10.914291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:10.920801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.921521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.922127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.923051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:10.923510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:10.923984 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:10.962507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:10.972212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-617e5b28-d9b5-4694-a3ef-de97f3031cc6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1271 microversion: 2.1 time: 0.099960 Oct 06 08:16:10.973101 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 190/365] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:10 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:11.062835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:11.070736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b91346fd-9f63-48fd-8c2d-144ed343db0b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.170965 Oct 06 08:16:11.071337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 176/366] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:10 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:11.554560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:11.555203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:11.562120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:11.562604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:11.563075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:11.563769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:11.564248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:11.564674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:11.690020 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:11.698041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7fafd8ba-296e-4c8c-b167-90990244f5c6 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.147529 Oct 06 08:16:11.698620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 191/367] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:11 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:11.995126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:11.995754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:12.002043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.005783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.005783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.005783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.005783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.006123 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.067464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:12.075548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2de36a20-6f76-4ca0-9453-3f3f022e6bab tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1271 microversion: 2.1 time: 0.084437 Oct 06 08:16:12.076105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 177/368] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:11 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:12.094229 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:12.094855 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:12.100833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.101316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.101752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.102436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.102887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.105417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.238248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:12.248995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-16112063-ba08-4165-b4c8-a304707580ad tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.156016 Oct 06 08:16:12.248995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 192/369] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:12 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:12.722058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:12.722822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:12.729336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.730483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.731012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.731788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:12.732238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:12.732657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:12.871197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:12.878860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-60628dcb-734d-4608-8797-df9970013beb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.160904 Oct 06 08:16:12.879452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 178/370] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:12 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:13.097917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:13.098742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:13.108851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.110911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.111394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:13.112403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.112861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.113284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:13.187676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:13.196109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-595ca63f-e8b3-4010-950f-33302d0f3237 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1271 microversion: 2.1 time: 0.102136 Oct 06 08:16:13.197000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 193/371] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:13 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:13.270038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:13.270662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:13.277238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.277733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.278164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:13.278851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.279322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.279734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:13.416831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:13.424611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8cfc2fdc-e6cd-4e86-a50a-104d78093264 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.158432 Oct 06 08:16:13.425407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 179/372] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:13 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:13.902738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:13.903407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:13.906867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:13.916205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.917203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.917776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:13.918520 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:13.918999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:13.919481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:14.225380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:14.226256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:14.233761 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:14.234456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:14.235076 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:14.236083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:14.236718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:14.237148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:14.303472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=8 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:14.309953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:14.314060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-55ca4b9d-8797-4be9-a4b9-a35c4ce5d47f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1277 microversion: 2.1 time: 0.092794 Oct 06 08:16:14.314842 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 180/373] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:14 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:14.345330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:14.354898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c33e5775-72d5-4840-8d95-32a5285cff50 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.456140 Oct 06 08:16:14.356768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 194/374] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:13 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:14.448953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:14.449474 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:14.455832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:14.456364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:14.456799 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:14.457487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:14.457967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:14.458390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:14.588918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:14.596554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dae2fff2-111e-46f1-b6b3-f39843184eca tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.151802 Oct 06 08:16:14.611453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 181/375] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:14 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:15.337587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:15.338875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:15.345416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.348584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.348584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.348584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.348584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.349050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.359155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:15.383423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:15.384032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:15.391440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.391860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.392300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.392994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.393454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.394597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.412957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:15.487559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:15.498506 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0cc9abf3-b7d7-4a01-b886-db02a388c51f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.164704 Oct 06 08:16:15.499431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 195/376] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:15 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:15.543485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:15.551622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7b2390b5-260e-4b99-9597-da2c495874d2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.172321 Oct 06 08:16:15.552186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 182/377] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:15 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:15.620594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:15.621203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:15.627334 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.627851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.628291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.628986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:15.629459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:15.630213 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:15.764475 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:15.772607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-05cc587f-2501-4a65-81d9-01243da23569 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.156589 Oct 06 08:16:15.773269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 196/378] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:15 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:16.522454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:16.523085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:16.524950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:16.530919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.531414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.531803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.532514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.532966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.533387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.576072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:16.576681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:16.583253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.583749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.584187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.584927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.585414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.585842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.673432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:16.681570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6c568ce4-4fa2-4a48-aa90-3f972b18d43f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.163447 Oct 06 08:16:16.682148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 183/379] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:16 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:16.722687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:16.730489 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-331d5642-21e4-416a-977c-8c7ef85bcf9f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.159293 Oct 06 08:16:16.731076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 197/380] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:16 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:16.797119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:16.797794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:16.804601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.805079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.805511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.806196 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:16.806860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:16.807311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:16.940102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:16.948372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b84c0ac-5e95-48fa-b9ea-c9319481e0ab tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1507 microversion: 2.1 time: 0.155364 Oct 06 08:16:16.948979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 184/381] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:16 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:17.223104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "name": "network-vif-plugged", "status": "completed", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:17.233161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.234504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.235081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.248299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] Creating event network-vif-plugged:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:16:17.256194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-761792a1-12b1-40ae-aa39-4aaedc3e98cf req-6d5de9c5-a131-41ea-9303-617c46b7c1c6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044073 Oct 06 08:16:17.257933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 198/382] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:17.704831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:17.705720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:17.715279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.718758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.718758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.718758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.718758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.719442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.722528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:17.732299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7155ccf6-8eee-45e0-919e-a7dd514d59d9", "tag": "e9f3bf39-064b-4658-b472-6ee60d24dc92"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:17.742569 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.743074 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.743504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.757471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] Creating event network-changed:e9f3bf39-064b-4658-b472-6ee60d24dc92 for instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 on hv-cinder-86021 Oct 06 08:16:17.763724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-99aab2d7-c39f-430a-9577-8267607d4cfb req-1f1eb20c-5448-4384-8fe3-d0e4f1ff68c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036251 Oct 06 08:16:17.764652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 199/383] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:17.769950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:17.770722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:17.777634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.778357 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.782036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.782036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.782036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.782036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.903273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:17.914608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fe193b02-9dc8-4d6b-b59d-b4d13c229554 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.213452 Oct 06 08:16:17.917409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 185/384] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:17 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:17.971376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:17.972677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:17.973401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:17.981207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.981337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-141f5d1e-42be-4d32-a940-f0003b69fe5e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.215354 Oct 06 08:16:17.981866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 200/385] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:17 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:17.982006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.982507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:17.983523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:17.984093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:17.984589 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:18.132811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:18.142831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b09fb288-4656-4d22-bd35-ce7283e4afd3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1513 microversion: 2.1 time: 0.174166 Oct 06 08:16:18.143588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 186/386] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:17 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:18.943648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:18.944287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:18.956564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:18.956564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:18.956564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:18.956564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:18.956939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:18.956939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:19.006412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:19.007055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:19.016099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:19.024939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:19.024939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:19.024939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:19.024939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:19.025346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:19.098010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:19.108181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-704d47dc-e912-45b8-b4c3-c28f47aea0f6 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.168386 Oct 06 08:16:19.108747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 201/387] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:18 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:19.156095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:19.163848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d318be75-3b13-457f-bd32-7c94af6db80b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1359 microversion: 2.1 time: 0.162075 Oct 06 08:16:19.164407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 187/388] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:19 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:20.132125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:20.132997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:20.141848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.142730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.143231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.144251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.145078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.145565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.186351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:20.187023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:20.193513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.193998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.194707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.195422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.195889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.196561 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.287527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:20.296903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2205f326-ecc8-4c7e-aa36-2a6b393fee71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.168992 Oct 06 08:16:20.311503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 202/389] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:20 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:20.338272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:20.347047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8eb47772-e3be-4e20-9f70-32d7ba1de3be tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1550 microversion: 2.1 time: 0.164368 Oct 06 08:16:20.347746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 188/390] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:20 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:20.373089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:20.373711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:20.380116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.380608 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.381043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.381763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.382268 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.382640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.519335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:20.528310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-64d751f0-d716-43ad-a1a4-dfbd8d1e94ab tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1550 microversion: 2.1 time: 0.159217 Oct 06 08:16:20.528890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 203/391] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:20 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:20.549615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:20.554624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:20.555412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Searching by: {'deleted': False, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a'} {{(pid=121076) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 06 08:16:20.562693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.563182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.563617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.564334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.564782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.565203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.658327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.multi_cell_list [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121076) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 06 08:16:20.760087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f98c1985-7265-49bb-9653-8906eec3a022 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214234 Oct 06 08:16:20.760674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 189/392] 10.222.0.30 () {58 vars in 1125 bytes} [Thu Oct 6 08:16:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:20.772901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:20.773516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:20.779921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.780402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.780836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.781515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:20.781965 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:20.782387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:20.913957 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:20.921825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1b96c6aa-73e5-405e-be4a-46200847ecc7 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1550 microversion: 2.1 time: 0.152708 Oct 06 08:16:20.922390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 204/393] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:20 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:21.323334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:21.324493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:21.330420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:21.330901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:21.331366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:21.332049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:21.332493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:21.332962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:21.429648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f6fe6a4-71b3-4ea1-bf57-e766cf856598 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: .version_select at 0x7f923bceb310>, body: {"keypair": {"name": "tempest-keypair-372537538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaOHGjyVNKJC8T1800eMw/bA7es23c4lZn1yp80r0//bGot4Ve6JXRnp/NpohskK04Bv3rwTGSKg5qV07K3IA/HOYwKRsjGF3LFb+d75J82v2CzGfb0LcflfhLUOIXLwA=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:21.447305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7f6fe6a4-71b3-4ea1-bf57-e766cf856598 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for project d5f023bd0dcf41558003e085c1dddf30. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:16:21.452530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7f6fe6a4-71b3-4ea1-bf57-e766cf856598 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for user 85bdfc4b6ad443d68ebc0d6932ccad66 and project d5f023bd0dcf41558003e085c1dddf30. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:16:21.466578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:21.474314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-51823066-526f-47c7-96e2-c4da7902b3b1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.155007 Oct 06 08:16:21.475033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 190/394] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:21 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:21.544579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7f6fe6a4-71b3-4ea1-bf57-e766cf856598 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.118511 Oct 06 08:16:21.545201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 205/395] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:16:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:16:22.499985 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:22.500665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:22.507759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:22.508238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:22.508703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:22.509382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:22.509876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:22.510289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:22.649052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:22.657236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-941987ef-000b-4bd0-a78f-e7e1e9b19f77 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.162780 Oct 06 08:16:22.660389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 191/396] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:22 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:23.681051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:23.681743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:23.688857 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:23.689397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:23.689872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:23.690564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:23.691069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:23.691492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:23.833159 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-812797150", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07f9b034-ef59-4413-807d-584389e10697"}], "security_groups": [{"name": "tempest-securitygroup--1603113358"}], "key_name": "tempest-keypair-372537538", "user_data": "}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:23.857779 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:23.876980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5e717ff2-a9ad-4641-b4c4-1e5d2b97856c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.199881 Oct 06 08:16:23.878378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 206/397] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:23 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:23.960989 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] validate_networks() for [('07f9b034-ef59-4413-807d-584389e10697', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:16:24.004315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7963166e-f4fe-4f7a-9d6c-fd1c2f437111"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:24.007009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:24.012880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.013356 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.014844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.014844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.015231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.015336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.377871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:16:24.379337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:16:24.379811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:16:24.380532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:16:24.380900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:16:24.390424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.390903 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.391362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.392077 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.392520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.392936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.409963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:16:24.414381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Getting quotas for user 85bdfc4b6ad443d68ebc0d6932ccad66 and project d5f023bd0dcf41558003e085c1dddf30. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:16:24.427773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:16:24.430062 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:16:24.557130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f643dd23-734c-4b1a-987d-adffb36a546d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.730546 Oct 06 08:16:24.558315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 192/398] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:16:23 2022] POST /compute/v2.1/servers => generated 409 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:16:24.570968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0264f406-93d5-4b3b-8bee-4de1d7819e68 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:24.571581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0264f406-93d5-4b3b-8bee-4de1d7819e68 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:24.630865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0264f406-93d5-4b3b-8bee-4de1d7819e68 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:24.638739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0264f406-93d5-4b3b-8bee-4de1d7819e68 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1244 microversion: 2.1 time: 0.072486 Oct 06 08:16:24.639404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 193/399] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:24 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:24.902967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:24.903940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:24.911047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.911540 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.911971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.912663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:24.913104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:24.913527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:24.929328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3698b9e6-66f6-443b-bc34-1f8632d1a47c tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928814 Oct 06 08:16:24.930681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 207/400] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:16:23 2022] POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:16:25.095633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:25.106693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-18e44e6d-1b14-47c6-9c0b-f1734947a44a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.209729 Oct 06 08:16:25.107297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 194/401] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:24 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:16:25.662790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:25.663445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:25.669894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:25.670378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:25.670815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:25.671531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:25.671987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:25.672405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:25.735209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:25.742870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1c33c189-874b-4a3e-a3d9-88b6e871a056 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1248 microversion: 2.1 time: 0.084892 Oct 06 08:16:25.743478 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 208/402] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:25 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:26.132393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:26.133058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:26.140522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:26.141027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:26.141466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:26.142171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:26.142624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:26.143080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:26.281190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:26.288889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c933df2c-1b3f-443a-b653-0d4209441555 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.162049 Oct 06 08:16:26.289431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 195/403] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:26 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:26.765719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:26.766324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:26.772704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:26.773186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:26.773618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:26.774293 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:26.774737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:26.775187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:26.836209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:26.844252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c51e3659-9954-4a16-8c64-e29b8e947222 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1296 microversion: 2.1 time: 0.082342 Oct 06 08:16:26.844808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 209/404] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:26 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:27.312019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:27.312640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:27.319023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:27.319499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:27.319930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:27.320605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:27.321065 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:27.321484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:27.457868 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:27.465769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b12b6480-cbd0-42bb-a5a2-c792124a1ed1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.157710 Oct 06 08:16:27.466528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 196/405] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:27 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:27.704917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7155ccf6-8eee-45e0-919e-a7dd514d59d9", "name": "network-vif-plugged", "status": "completed", "tag": "e9f3bf39-064b-4658-b472-6ee60d24dc92"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:27.714644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:27.715158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:27.715590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:27.728321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] Creating event network-vif-plugged:e9f3bf39-064b-4658-b472-6ee60d24dc92 for instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 on hv-cinder-86021 Oct 06 08:16:27.735788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-624d2b06-3315-4be4-84b1-e233c8bc0c3f req-7e26d262-09cc-49eb-ad18-454598d2b8f6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032507 Oct 06 08:16:27.735788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 210/406] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:27.867795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:27.869001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:27.877043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:27.894438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:27.895273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:27.896068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:27.896570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:27.896998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:27.967522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:27.975390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e153b03c-75fb-4352-9aae-443cc3d1b281 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1302 microversion: 2.1 time: 0.111585 Oct 06 08:16:27.975963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 197/407] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:27 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1302 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:28.492675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:28.492675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:28.493245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:28.499246 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:28.499738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:28.500176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:28.500874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:28.501324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:28.501747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:28.629352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:28.637846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-97f5d2f6-e12b-4a1d-a17a-2563105806f8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.152379 Oct 06 08:16:28.638416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 211/408] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:28 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:28.999980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:29.000581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:29.008246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:29.009214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:29.009658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:29.010579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:29.011143 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:29.012317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:29.152887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:29.164006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-238e4959-1481-4050-982a-021379b493cf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.168928 Oct 06 08:16:29.164755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 198/409] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:28 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:29.559617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:29.572377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:29.572854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:29.573420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:29.584609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] Creating event network-changed:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:16:29.590875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-0b7fa518-e135-4cf5-b60a-0862094a9667 req-a5b4a822-2bc1-4a4a-84bb-d464567ba565 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035940 Oct 06 08:16:29.591735 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 212/410] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:29.662531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:29.663169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:29.670131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:29.671564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:29.671564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:29.672578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:29.673026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:29.673443 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:29.801907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:29.810979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6c6c86ad-c097-401b-9d78-44d1f60fe291 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1319 microversion: 2.1 time: 0.152770 Oct 06 08:16:29.811258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 199/411] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:29 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:30.188820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:30.189591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:30.195780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:30.196594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:30.197252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:30.198148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:30.199990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:30.200438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:30.492231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:30.500677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e0a37d66-d24a-4990-8f1e-703ad55ea60a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.317504 Oct 06 08:16:30.501245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 213/412] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:30 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:30.833312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:30.833924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:30.840387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:30.840872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:30.841307 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:30.841998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:30.842451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:30.842874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:30.974183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:30.982330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a04f297-8d84-44df-bd48-794f47300188 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1507 microversion: 2.1 time: 0.152971 Oct 06 08:16:30.982894 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 200/413] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:30 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:31.524504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:31.525210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:31.529471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:31.533164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:31.533654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:31.537583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:31.537583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:31.537583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:31.537583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:31.539743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:31.718870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:31.726783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-60ab57ce-1013-454b-a7e0-de7129dfdcf3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.206119 Oct 06 08:16:31.727380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 214/414] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:31 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:32.749087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:32.749736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:32.757350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:32.757841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:32.759026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:32.759185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:32.759644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:32.760069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:32.896645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:32.904933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8b26df37-9b0e-406f-bb3f-219e03b935e3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.160258 Oct 06 08:16:32.905504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 201/415] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:32 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:33.933744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:33.934364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:33.941358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:33.941848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:33.942358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:33.943090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:33.943549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:33.943987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:34.080748 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:34.088660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b3f5df46-9ac8-478f-9146-ec34086e7d5f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.159718 Oct 06 08:16:34.089278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 215/416] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:33 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:34.753216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:34.753816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:34.756371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=4 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:34.757070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=8 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:34.761975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:34.763111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:34.763543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:34.764262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:34.764710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:34.765126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:34.900429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:34.909721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9d40b5fa-0c2a-48ea-94ee-8d201e4875c5 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1596 microversion: 2.1 time: 0.160270 Oct 06 08:16:34.910289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 202/417] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:34 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1596 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:35.112135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:35.112759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:35.119338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:35.119781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:35.123958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:35.123958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:35.123958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:35.123958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:35.332226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:35.340032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d0eb7f6b-4158-4ffd-8f52-09a65db837f9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.231794 Oct 06 08:16:35.340635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 216/418] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:35 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:36.365041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:36.365678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:36.372827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:36.373318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:36.373750 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:36.374457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:36.374913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:36.375375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:36.380110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:36.517138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:36.525418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f1008142-5f1e-4cef-a2c2-c7ba83b02336 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.164424 Oct 06 08:16:36.526735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 203/419] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:36 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:37.152909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:37.163557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:37.164041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:37.164471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:37.179622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] Creating event network-changed:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:16:37.185947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-55b10138-0e51-43a5-8576-140e21d584f2 req-ffc53e02-fd83-4074-8b20-62e982030e0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036598 Oct 06 08:16:37.186553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 217/420] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:37.548599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:37.549510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:37.557167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:37.557819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:37.558373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:37.560050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:37.560639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:37.561181 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:37.730613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:37.738506 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c8dbf55b-9306-428f-bdfa-146ea44faf5c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.193902 Oct 06 08:16:37.739155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 204/421] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:37 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:38.762894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:38.763613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:38.770306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:38.770789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:38.771247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:38.771933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:38.772385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:38.772806 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:38.907205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:38.916046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-76ba432f-ca8c-4aa1-90f1-b83adf1f679c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.157813 Oct 06 08:16:38.917449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 218/422] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:38 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:39.940483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:39.941119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:39.947643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:39.948130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:39.948555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:39.949242 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:39.950441 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:39.950911 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:40.155641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:40.163238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3485418e-67f3-4c22-b1d9-29803fa858ae tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.227021 Oct 06 08:16:40.163795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 205/423] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:39 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:40.460902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-189971562"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:40.461424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:40.468242 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:40.468722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:40.469703 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:40.470480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:40.470932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:40.471371 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:40.611793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.network.security_group_api [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Adding security group 419fef34-2938-4488-8acd-4fa656ff87cc to port acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 Oct 06 08:16:41.022534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c7c70277-2714-43bb-9b57-01aa9bdbb520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action" status: 202 len: 0 microversion: 2.1 time: 0.565713 Oct 06 08:16:41.026513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 219/424] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:16:40 2022] POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:16:41.035352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:41.036723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:41.038078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:41.046630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:41.047156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:41.047973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:41.048845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:41.049996 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:41.050438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:41.054003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:41.054540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:41.055004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:41.069374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] Creating event network-changed:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:16:41.077120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-9ed9ee53-f155-4ae7-b4bd-53f3428da469 req-59474aed-1bfd-45bb-b6d1-c9cc18c310c5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044138 Oct 06 08:16:41.078320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 220/425] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:41.193323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:41.195600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:41.203907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:41.205068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:41.205934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:41.206774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:41.207467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:41.208124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:41.230122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:41.241587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-36676080-35fe-4bf2-a266-18da00fb2a63 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1761 microversion: 2.1 time: 0.213589 Oct 06 08:16:41.242691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 206/426] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:41 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1761 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:41.692073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:41.699817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d674815e-883b-4c8d-a7ce-d56d5c4fec70 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.511981 Oct 06 08:16:41.700464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 221/427] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:41 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:42.193142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:42.193717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:42.200995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.201756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.202366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.203091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.203547 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.203970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.225160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:42.225813 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:42.230713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-70179587-428c-4dad-b386-3e24ac56d1d0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/ips" status: 200 len: 151 microversion: 2.1 time: 0.041772 Oct 06 08:16:42.231601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 207/428] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:16:42 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:42.233937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.235043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.235791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.237236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.238069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.238528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.270000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e794f833-6865-431a-b671-c325c4774b5a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/ips" status: 200 len: 145 microversion: 2.1 time: 0.049710 Oct 06 08:16:42.270594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 222/429] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:16:42 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:42.718733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "name": "network-vif-plugged", "status": "completed", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:42.729529 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:42.730417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:42.736666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.737680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.738314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.738538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.739395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.740026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.741074 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:42.741587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:42.742199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:42.770886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] Creating event network-vif-plugged:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:16:42.777090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-39095a24-b025-4b41-90b4-c8d4b598f24b req-0d90c371-c837-4f64-a86a-033cf94a8b79 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066103 Oct 06 08:16:42.778658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 208/430] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:42.956621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:42.964727 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c0d4c27a-1d96-444c-a605-ee3cd3022dc3 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.240442 Oct 06 08:16:42.965762 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 223/431] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:42 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:43.389562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:43.390152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:43.396431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:43.396912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:43.402153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:43.402153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:43.402153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:43.402153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:43.423131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fa67bc48-c85f-4aef-b846-64d11cc2f9bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/ips" status: 200 len: 150 microversion: 2.20 time: 0.038867 Oct 06 08:16:43.423695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 209/432] 10.222.0.30 () {60 vars in 1289 bytes} [Thu Oct 6 08:16:43 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:16:43.987947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:43.988647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:43.995743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:43.996335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:43.997331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:43.998001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:43.998514 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:43.998872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:44.209453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:44.218468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-71088081-a4d7-46d3-a5e1-fd9af90e5adb tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.234373 Oct 06 08:16:44.219062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 224/433] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:43 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:45.241732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:45.242333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:45.249430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:45.249904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:45.250337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:45.251038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:45.251489 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:45.251905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:45.381392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:45.389748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-23a3a2de-4994-4168-8b46-4625560a9596 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.152096 Oct 06 08:16:45.390315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 210/434] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:45 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:46.411978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:46.412521 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:46.418877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:46.419377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:46.419808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:46.420488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:46.420966 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:46.421400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:46.553570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:46.561770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a34f9e32-b0d1-4b07-9219-dbca62fabc16 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.153811 Oct 06 08:16:46.562322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 225/435] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:46 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:47.583912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:47.584561 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:47.586502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:47.592348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:47.592838 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:47.593278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:47.593966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:47.594480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:47.594931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:47.727982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:47.735771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7bb9baff-58ac-46b0-aeab-66c4b710309f tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.155792 Oct 06 08:16:47.736340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 211/436] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:47 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:48.758230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:48.758988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:48.765572 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:48.766051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:48.766483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:48.767193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:48.767639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:48.768063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:48.896820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:48.905163 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c606cb20-478c-40e7-8ca5-99ce48d4d91c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.151019 Oct 06 08:16:48.905800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 226/437] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:48 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:49.928170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:49.928770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:49.935867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:49.936355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:49.936793 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:49.937470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:49.937923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:49.938345 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:50.290043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:50.298453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e13e819c-8f4d-4c30-a231-56f270e53f9a tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.374027 Oct 06 08:16:50.299051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 212/438] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:49 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:51.322413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:51.323059 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:51.329797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:51.330277 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:51.330718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:51.331429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:51.331935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:51.332393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:51.467999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:51.476533 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-61688d4b-1011-454b-9b5e-75b2e8b6528d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.157857 Oct 06 08:16:51.477117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 227/439] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:51 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:52.500861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:52.501461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:52.508367 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:52.508846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:52.509278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:52.509956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:52.510401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:52.510817 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:52.664954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:52.674659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-64714802-d954-4742-8ca7-9abcbd5b08df tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1370 microversion: 2.1 time: 0.178178 Oct 06 08:16:52.675254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 213/440] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:52 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:53.667464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:53.670374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:53.676734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.677203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.677628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.678305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.678753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.679199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.698301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:53.699106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:53.705504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.705993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.706430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.707153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.707610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.708032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.841585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:53.849568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-77488cef-6fea-41f2-bf3d-dc006c22df9e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1563 microversion: 2.1 time: 0.155246 Oct 06 08:16:53.850300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 214/441] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:16:53 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:16:53.872856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:53.873435 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:53.879440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.879925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.880359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.881288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:53.881768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:53.882182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:53.959969 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fb777787-d394-443b-a7e0-468029d6db52 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091412 Oct 06 08:16:53.960562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 215/442] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:16:53 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:16:54.602565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0bd110dd-a98e-4a57-b6c7-d19ac71797e7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938905 Oct 06 08:16:54.603303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 228/443] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:16:53 2022] POST /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:54.722616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "027c5f57-531a-4e02-b6c4-5f405c734d8f"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:54.725554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:54.732363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:54.732858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:54.733364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:54.733987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:54.734634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:54.735379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:55.029668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:55.041654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:55.042130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:55.042553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:55.056559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] Creating event network-changed:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:16:55.062992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-8537dcd0-00ed-4d08-8ca6-807dd4152dd3 req-57105d3a-fda1-479e-9a19-7752e25f88b2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038147 Oct 06 08:16:55.064216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 229/444] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:16:55.655204 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-10ff6c9f-e4ed-4613-a23f-cdb6813f01e0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936625 Oct 06 08:16:55.656087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 216/445] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:16:54 2022] POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:16:56.376890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:16:56.377501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:56.384377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:56.384851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:56.385300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:56.385973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:56.386421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:56.386835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:56.409088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lazy-loading 'flavor' on Instance uuid aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:16:56.499261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:16:56.836079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-123a3ecc-6ddb-4128-96b7-81818b24fbb8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/action" status: 202 len: 0 microversion: 2.20 time: 0.463473 Oct 06 08:16:56.837266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 230/446] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Oct 6 08:16:56 2022] POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:16:56.846933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:56.848332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:56.854764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:56.855356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:56.855736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:56.856879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:56.857341 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:56.857766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:56.986621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:56.994908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:56.996420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:56.997639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e7690bef-c46d-4a6e-82be-9948be37ca5e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.155524 Oct 06 08:16:56.998124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 217/447] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:16:56 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:16:58.024592 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:58.025319 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:58.032191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:58.032674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:58.033138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:58.033826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:58.034277 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:58.034697 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:58.169512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:58.178337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:58.179871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:58.181021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-febcec44-ba71-41e5-aa46-c72d20d22afa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.161121 Oct 06 08:16:58.181575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 231/448] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:16:58 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:16:59.207167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:16:59.207772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:16:59.214133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:59.214609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:59.215082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:59.215754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:16:59.216197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:16:59.216613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:16:59.346524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:59.354741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:59.356580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:16:59.358479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ba0da8f7-80d9-40dd-80aa-1a9a85db89b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.154510 Oct 06 08:16:59.359083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 218/449] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:16:59 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:00.384134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:00.384731 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:00.387381 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=42 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:00.392328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:00.392808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:00.398522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:00.398522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:00.398522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:00.398522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:00.524269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:00.532450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:00.533898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:00.535123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3583ec6d-c887-495d-a453-a721919f23bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.155212 Oct 06 08:17:00.535681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 232/450] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:00 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:01.560936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:01.561470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:01.567849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:01.568324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:01.568754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:01.569427 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:01.569872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:01.570287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:01.701698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:01.709917 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:01.711384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:01.712534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-22575c2d-4404-4786-87b6-f33191e5030a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.155598 Oct 06 08:17:01.713089 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 219/451] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:01 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:02.738611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:02.739255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:02.745660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:02.746136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:02.746568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:02.747295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:02.747745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:02.748332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:02.880322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:02.889170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:02.890809 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:02.892041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-138a0117-05e8-437c-8ee2-c6b67ea4151c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.157453 Oct 06 08:17:02.892605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 233/452] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:02 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:03.917796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:03.918395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:03.925852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:03.926331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:03.926768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:03.927498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:03.927954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:03.928378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:03.931015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:04.060720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:04.068809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:04.070267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:04.071458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4b8bdb32-73e2-43f7-92b8-b3a24c4ba0c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.157598 Oct 06 08:17:04.072018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 220/453] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:03 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:05.097741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:05.100191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:05.105015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:05.105508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:05.105946 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:05.106637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:05.107123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:05.107549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:05.236977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:05.246230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:05.248235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:05.249571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e3466a61-5e26-4c2e-a0d0-291c7a23b5f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.156814 Oct 06 08:17:05.250222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 234/454] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:05 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:06.276507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:06.277111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:06.283898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:06.284388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:06.284824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:06.285514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:06.285971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:06.286867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:06.421457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:06.429537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:06.431053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:06.432212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-07bb9a99-95e0-4b73-8169-249a43bf8a31 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.159580 Oct 06 08:17:06.432761 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 221/455] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:06 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:07.463381 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:07.464063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:07.471238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:07.473736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:07.473736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:07.473736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:07.473736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:07.474055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:07.608843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:07.617522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:07.618970 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:07.620120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c97998f3-3fcc-4134-98a5-c1b9e56eafd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.160636 Oct 06 08:17:07.620668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 235/456] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:07 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:08.609446 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7d205d3f-e618-43be-a542-eab74ff58c46 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: .version_select at 0x7f9237db3310>, body: {"keypair": {"name": "tempest-keypair-651056390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSAXCtnnGrxx2e444Ln47b84/hsqlu2sFuBhZ942R0Pr78NauzzPY7wmUwgtHP2XbcQF/gmkEIFSmiN2lkXBJtNAaPYeFOenKA76hi+tPQp3cbc9gCRubArzzvBy5jm1g=="}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:08.625340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7d205d3f-e618-43be-a542-eab74ff58c46 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:17:08.630087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7d205d3f-e618-43be-a542-eab74ff58c46 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:17:08.645438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:08.646042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:08.654526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:08.656877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:08.656877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:08.656877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:08.656877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:08.657209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:08.685484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7d205d3f-e618-43be-a542-eab74ff58c46 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.080066 Oct 06 08:17:08.686275 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 222/457] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:17:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:08.806286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:08.815237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:08.816701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:08.817870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d67bebdf-60dc-49a5-82ca-666ac31b1dad tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.177129 Oct 06 08:17:08.818472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 236/458] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:08 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:09.843211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:09.843820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:09.851887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:09.852422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:09.852884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:09.853571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:09.854027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:09.854449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:09.984790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:09.994104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:09.995655 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:09.996848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c9b68064-88aa-4bc2-915e-2711da9269f8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.157695 Oct 06 08:17:09.997400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 223/459] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:09 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:10.953914 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1438623873", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916cf03d-8c1b-4b3b-a1cf-702059cc42e1"}], "security_groups": [{"name": "tempest-securitygroup--1887359643"}], "key_name": "tempest-keypair-651056390", "user_data": "}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:11.023149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:11.024157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:11.035348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.036338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.037187 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.038556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.039376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.039872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.060502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] validate_networks() for [('916cf03d-8c1b-4b3b-a1cf-702059cc42e1', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:17:11.181360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:11.189548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:11.196549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:11.197683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ed052a9c-e38c-47cb-bd27-6624a09b38ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.180077 Oct 06 08:17:11.198247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 224/460] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:11 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:11.431418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84c8690b-075a-4dce-ac01-9f499fae4f60", "device": "/dev/sdb"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:11.434271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:11.441624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.442116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.442446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:17:11.442551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.442865 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:17:11.443312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.443722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:17:11.443848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.444134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:17:11.444247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.444543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:17:11.454871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.456418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.462351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.462351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:11.462351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:11.462351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:11.477494 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:17:11.481830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:17:11.494206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:17:11.496537 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:17:11.602740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-bfe94bab-be66-475d-967f-2da39cadb5d7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.653067 Oct 06 08:17:11.603653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 237/461] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:17:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:17:11.615232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-54f9b9c1-23d9-4d2d-b3ca-d1af6640c3d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:11.616310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-54f9b9c1-23d9-4d2d-b3ca-d1af6640c3d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:11.680318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-54f9b9c1-23d9-4d2d-b3ca-d1af6640c3d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:11.692235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-54f9b9c1-23d9-4d2d-b3ca-d1af6640c3d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1241 microversion: 2.1 time: 0.081259 Oct 06 08:17:11.693465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 238/462] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:11 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:12.224413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:12.225021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:12.231534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:12.232016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:12.232446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:12.233123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:12.233567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:12.233982 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:12.254381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1446dc0f-d00b-409e-8e0c-6a603c872ed4 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "POST /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820912 Oct 06 08:17:12.254381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 225/463] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:17:11 2022] POST /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9/os-volume_attachments => generated 194 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:17:12.369901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:12.378208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:12.379706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:12.380852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-42f5b391-49e6-434b-8fca-755cb938d6ec tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.161077 Oct 06 08:17:12.381674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 239/464] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:12 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:12.717927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:12.718621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:12.725956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:12.726434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:12.726864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:12.727670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:12.728122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:12.728545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:12.794614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:12.803209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0bc140ef-2b26-4c05-928e-a821b52c331b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1245 microversion: 2.1 time: 0.089536 Oct 06 08:17:12.803778 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 226/465] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:12 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:13.411089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:13.411089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:13.414874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:13.415382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:13.415810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:13.416582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:13.416946 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:13.417363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:13.547564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:13.555517 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:13.560488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:13.560488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-32aa974f-fffe-49bf-a99a-706bcfcc2a28 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.155155 Oct 06 08:17:13.560488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 240/466] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:13 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:13.825518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:13.826115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:13.832837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:13.833308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:13.833736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:13.834409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:13.834854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:13.835303 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:13.896699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:13.904597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bb133146-a942-4b7b-9c38-de854feeb691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1293 microversion: 2.1 time: 0.082893 Oct 06 08:17:13.905197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 227/467] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:13 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:14.585993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:14.586535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:14.593734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:14.594663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:14.595355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:14.596389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:14.598372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:14.599031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:14.732477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:14.741672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:14.743913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:14.745348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b83cfdb2-963b-40f0-a510-6d97884aee24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.165390 Oct 06 08:17:14.759506 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 241/468] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:14 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:14.928124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:14.928831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:14.936125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:14.936646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:14.937078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:14.940305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:14.940305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:14.940305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:15.002770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:15.011171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ea3fcedd-f19e-48cc-ac85-40ab92172cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1311 microversion: 2.1 time: 0.087104 Oct 06 08:17:15.011731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 228/469] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:14 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:15.772942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:15.777032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:15.782014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:15.782764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:15.783449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:15.785105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:15.786010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:15.786744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:16.021771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:16.033378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:16.033558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:16.034141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:16.036954 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:16.038499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7b1b659c-6589-4a95-adc4-595a4a07a1d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.269894 Oct 06 08:17:16.050844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:16.051450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 242/470] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:15 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:16.051971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:16.052531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:16.053309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:16.059417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:16.060246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:16.139807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:16.149059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-427d35cc-f078-4a72-93b6-d2ef77a9af31 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1299 microversion: 2.1 time: 0.119386 Oct 06 08:17:16.165908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 229/471] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:16 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:17.066145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:17.066672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:17.067944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:17.073162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.073741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.074243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.076565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.077286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.077879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.078742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.079391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.079965 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.140927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Going to try to stop instance {{(pid=121076) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 08:17:17.256882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:17.265128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:17.266652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:17.268021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f5fb3baf-3aa0-46ad-a536-fd2133a6c5fe tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.206385 Oct 06 08:17:17.268605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 243/472] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:17 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:17.273763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:17.274367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:17.280225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.280805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.281245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.282114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.282568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.283015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.418364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:17.427396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8b98ae73-35f2-48e7-9d88-886c538b1318 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.157146 Oct 06 08:17:17.428035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 244/473] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:17 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:17.432829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb0dfcf-fa42-40d8-b33c-b143432d90ad", "tag": "bae8df64-50c3-4330-a9c1-a7d4846124b1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:17.433022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f96d4e0e-cabc-4276-a1ee-ca707838c069 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action" status: 202 len: 0 microversion: 2.1 time: 0.370324 Oct 06 08:17:17.434396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 230/474] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:17:17 2022] POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:17:17.443578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.444168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.444607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.447524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:17.448471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:17.457744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] Creating event network-changed:bae8df64-50c3-4330-a9c1-a7d4846124b1 for instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad on hv-cinder-86021 Oct 06 08:17:17.458395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.459052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.459838 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.460650 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.461334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.464061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-090d3574-8456-4b11-a10e-8a87b8188506 req-6d813625-ad40-4487-9748-e36fed9ddd26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034681 Oct 06 08:17:17.464257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.466201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 245/475] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:17.608704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:17.617439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "name": "network-vif-plugged", "status": "completed", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:17.617659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-93bdd1dd-8496-435b-ab87-5e15ccb092bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.177397 Oct 06 08:17:17.618390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 231/476] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:17 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:17.628013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:17.628713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:17.629139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:17.640921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] Creating event network-vif-plugged:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:17:17.646588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-9398084d-eb26-422b-a61a-227cd5e2f760 req-26c75c7d-7f4a-4b2a-a479-7be55229001b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034299 Oct 06 08:17:17.647252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 246/477] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:17:18.293520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:18.294061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:18.296499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:18.301268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.301754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.302193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.302887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.303440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.303951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.437306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:18.446338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:18.447804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:18.448950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6b4835d8-3a72-480e-b60f-2a3b3745f2e4 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.159478 Oct 06 08:17:18.449508 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 232/478] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:18 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:18.450834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:18.451578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:18.462834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.463356 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.463796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.464502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.464956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.465383 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.592948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:18.601421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f6f51014-914f-477d-8f44-2729629ae788 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.155405 Oct 06 08:17:18.601992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 247/479] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:18 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:18.641792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:18.642405 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:18.644854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=4 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:18.649704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.650192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.650630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.651347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:18.651805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:18.658337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:18.779312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:18.787706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2a0d5a72-6c73-49ca-bf05-93fa8b20bf3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.150076 Oct 06 08:17:18.788580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 233/480] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:18 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:19.167351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-952465551", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:19.219552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] validate_networks() for None {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:17:19.478916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:19.479696 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:19.488463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.489471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.489916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.490663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.491213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.491579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.627865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:19.636235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:19.637774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:19.638925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f181aea1-232e-44a6-814b-8b6fead8b5b5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.165830 Oct 06 08:17:19.639498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 234/481] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:19 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:19.644172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:19.644772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:19.650835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.651364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.651807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.652492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.652944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.653369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.668708 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:19.736147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:17:19.736575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:17:19.737041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:17:19.737543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:17:19.737960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:17:19.747350 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.747832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.748301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.749444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.749956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.750415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.767757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Getting quotas for project 35d7501875734ba1a41351b2ac57db09. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:17:19.772318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Getting quotas for user 2d2a46971e1e459e92fabdc8a5c54d10 and project 35d7501875734ba1a41351b2ac57db09. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:17:19.783488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:17:19.783807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:19.786459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:17:19.792357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-318539d7-64a0-4351-8f58-a8fb5fea4b23 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.151758 Oct 06 08:17:19.792915 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 235/482] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:19 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:19.811520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:19.812122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:19.818313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.818854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.819325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.820023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:19.820481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:19.820951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:19.898712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7dfd4cbc-7b57-47d5-b91e-29dbbe7e4b4e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735114 Oct 06 08:17:19.899397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 248/483] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:17:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:17:19.911226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9689cd36-efc1-41c1-941c-f3dd2e0356d7 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:19.912140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9689cd36-efc1-41c1-941c-f3dd2e0356d7 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:19.966787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9689cd36-efc1-41c1-941c-f3dd2e0356d7 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:19.974324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9689cd36-efc1-41c1-941c-f3dd2e0356d7 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1214 microversion: 2.1 time: 0.067894 Oct 06 08:17:19.975444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 249/484] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:19 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:20.004885 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:20.014395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ca66a440-d320-437c-8aa8-31551a062e7a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.206656 Oct 06 08:17:20.015163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 236/485] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:19 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:20.664748 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:20.665403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:20.671784 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:20.676550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:20.676550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:20.676550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:20.676550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:20.676905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:20.806171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:20.814531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:20.815189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:20.815802 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:20.816010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:20.817696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-efb0be71-182b-4fe9-b0db-6bbd7cc660e2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.157132 Oct 06 08:17:20.818974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 250/486] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:20 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:20.822731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:20.823252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:20.823692 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:20.824379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:20.824833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:20.825252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:20.954525 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:20.963423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e970e0da-7f06-4c47-b835-c52f063432f0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.151407 Oct 06 08:17:20.963423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 237/487] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:20 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:20.997607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:20.998214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:21.004329 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.005433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.005944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.006895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.007373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.007794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.022983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:21.037663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:21.038487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:21.045339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.045831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.046321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.047217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.047681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.048110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.068672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:21.076258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f4362ed8-de4f-4abd-a880-abc1e85c5515 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1218 microversion: 2.1 time: 0.082578 Oct 06 08:17:21.077012 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 251/488] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:20 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:21.178583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:21.186808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-618a2238-ce7d-4a17-a4e0-02901780492c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.153020 Oct 06 08:17:21.187937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 238/489] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:21 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:21.844962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:21.845880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:21.854479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.855062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.855573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.856341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.856866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.857287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.985786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:21.986499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:21.994787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.995475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.996010 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:21.996928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:21.997474 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:21.998165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:22.079831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.104326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.104326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.104326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-abb5db06-8954-4b11-9d4f-bd2d2d17807e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.250995 Oct 06 08:17:22.104794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 252/490] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:21 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:22.104794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:22.104794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:22.109393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:22.110001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:22.110559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:22.111471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:22.112066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:22.112588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:22.164947 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.170854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6f89701c-f0d0-4260-86c0-37601ad4908d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.189040 Oct 06 08:17:22.171754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 239/491] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:21 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:22.191040 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.199433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c250138d-f093-4b77-8069-5a87014533e9 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1218 microversion: 2.1 time: 0.103681 Oct 06 08:17:22.200006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 253/492] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:22 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:22.210542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:22.211592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:22.217834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:22.218322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:22.218758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:22.219512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:22.219962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:22.220384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:22.361533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:22.372320 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a645891d-f1f7-4fb4-9467-1f700a3053ed tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.166165 Oct 06 08:17:22.372912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 240/493] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:22 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:23.117382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:23.117985 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:23.127969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.127969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.127969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.127969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.128486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.128486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.194965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:23.195576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:23.201852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.202331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.202757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.203470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.203916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.204333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.265981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.275694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.277164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.278320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-16c851b1-1226-444a-967f-7e24395d622f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.164919 Oct 06 08:17:23.278873 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 254/494] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:23 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:23.283398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:23.283992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:23.290136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.290612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.291070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.291749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.292192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.292605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.340826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.349056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cdef8689-d969-41ee-8064-4ab92bf67bfb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.157880 Oct 06 08:17:23.349634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 241/495] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:23 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:23.353600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.361634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-51e3f9ab-2186-4e79-bfa0-555abfd794de tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1266 microversion: 2.1 time: 0.081808 Oct 06 08:17:23.362179 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 255/496] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:23 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:23.397065 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:23.397599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:23.403392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.403863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.404299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.404983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:23.405436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:23.405859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:23.535458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:23.544269 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8a846a08-255d-49cd-abb4-7caff2e711f9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.152241 Oct 06 08:17:23.551950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 242/497] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:23 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:24.303808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:24.308096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:24.310513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.311026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.311459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.312132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.312579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.312993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.372021 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:24.373245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:24.380769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.381222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.382110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.383086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.383370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.383793 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.450845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.459202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.460637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.461786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e3d85d9e-5959-4508-888e-d87b7280225b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.162447 Oct 06 08:17:24.462352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 256/498] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:24 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:24.471504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:24.472115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:24.479686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.480304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.480950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.481821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.482382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.482896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.531572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.540901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ea1adc62-e010-4b4e-ba9b-987546cb00c1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.172653 Oct 06 08:17:24.541739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 243/499] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:24 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:24.556850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.564653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f9822b04-152a-4ee3-9ff5-e1c580fc55cb tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1284 microversion: 2.1 time: 0.097134 Oct 06 08:17:24.565303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 257/500] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:24 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:24.568573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:24.569163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:24.575348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.575817 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.576318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.577072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.577588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.578223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.609557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb0dfcf-fa42-40d8-b33c-b143432d90ad", "name": "network-vif-plugged", "status": "completed", "tag": "bae8df64-50c3-4330-a9c1-a7d4846124b1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:24.621009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:24.621490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:24.621922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:24.637740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] Creating event network-vif-plugged:bae8df64-50c3-4330-a9c1-a7d4846124b1 for instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad on hv-cinder-86021 Oct 06 08:17:24.639388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-3e8ba17b-0860-497d-bba6-7876bd12051d req-2d5ed21f-3315-47f3-97f8-4c8725d924b4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Oct 06 08:17:24.640022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 258/501] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:17:24.706203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:24.714535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-809e0765-014b-43fd-ad28-47be33038b3d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.150320 Oct 06 08:17:24.715128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 244/502] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:24 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:25.488302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:25.489113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:25.496528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.496828 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.497496 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.498189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.498810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.499335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.576863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:25.579481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:25.588274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.589040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.589515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.590436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.590856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.591331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.704081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.716125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.718244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.719767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-43b075e2-d0d7-4cb5-8e2d-29b085f33ffa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1744 microversion: 2.20 time: 0.236293 Oct 06 08:17:25.723663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 259/503] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:25 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1744 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:25.731414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:25.732395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:25.745493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.746804 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.747333 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.747747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.748443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.748891 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.749309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.753452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0a7d15e2-fc26-4e2f-91cf-f62402ba7add tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.188550 Oct 06 08:17:25.754055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 245/504] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:25 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:25.760410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:25.761046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:25.772102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.778543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.778543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.778543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:25.778543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:25.779088 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:25.921955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.931351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5d6ce346-4b0b-4337-adbc-604b4607ce89 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.205031 Oct 06 08:17:25.932111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 260/505] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:25 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:25.942316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:25.953701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-57684bdc-e90a-40c5-a786-68137e4b00bf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.198029 Oct 06 08:17:25.954551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 246/506] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:25 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:26.748173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:26.748904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:26.756042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.756944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.757380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.758071 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.758517 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.758988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.778382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:26.779482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:26.786310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.787821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.788285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.789039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.789624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.790410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.919603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:26.927235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-226dc90d-1a45-4de7-a8de-3b16d6588f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.153512 Oct 06 08:17:26.927823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 247/507] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:26 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:26.955814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:26.956417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:26.962801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.963311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.963743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.966624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:26.974780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:26.976255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:26.977454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5dc23c98-3b3d-46be-a246-4d404ad36745 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.233207 Oct 06 08:17:26.978005 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 261/508] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:26 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:26.979672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.980151 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.980580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.990987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:26.990987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:26.994851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.995367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.995798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:26.996480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:26.996927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:26.997341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:27.132717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:27.140521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d537879f-6631-43e3-8d18-9febd193950c tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.188488 Oct 06 08:17:27.148246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 248/509] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:26 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:27.160425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f9a5b6-299d-401b-8fb4-228aafc743c0", "tag": "591be2db-72cd-443f-98f5-b22af346e6e4"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:27.167325 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:27.178413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:27.178413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:27.178413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:27.178708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-299f756e-1688-4425-b43f-8fdf4e6bccb1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.198509 Oct 06 08:17:27.178708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 262/510] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:26 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:27.183366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] Creating event network-changed:591be2db-72cd-443f-98f5-b22af346e6e4 for instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 on hv-cinder-86021 Oct 06 08:17:27.188401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-4577a48d-0ba0-46ec-b1ac-056e73894b7d req-3e1bc48e-2a71-437f-8a72-e6c7acec0330 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Oct 06 08:17:27.189138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 249/511] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:17:27.949432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:27.950044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:27.956708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:27.957217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:27.957654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:27.958343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:27.959875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:27.960304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.007066 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:28.007767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:28.013781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.014265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.014699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.015429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.015881 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.016302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.093881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.102662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6de19443-bdce-4489-93cd-47d8c3c11047 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.156996 Oct 06 08:17:28.103271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 263/512] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:27 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:28.145308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.154845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.156316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.157468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0ccefe9e-1860-47fc-be96-38b778ff84c8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.156078 Oct 06 08:17:28.158019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 250/513] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:28 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:28.168161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:28.173315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:28.174623 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.175144 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.175571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.176251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.176694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.177111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.201537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:28.202179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:28.208224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.209390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.210011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.210715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:28.211199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:28.211626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:28.304472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.312295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-10f2cd10-7dff-4134-961a-917933514078 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.147927 Oct 06 08:17:28.312870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 264/514] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:28 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:28.340466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:28.348599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a8703a84-fcb0-4a5c-a96b-3f7d60552312 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.150941 Oct 06 08:17:28.349699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 251/515] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:28 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:29.125007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:29.125638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:29.128055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:29.133515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.133994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.134431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.135142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.135590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.136007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.183672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:29.184279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:29.190962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.191454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.191895 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.192580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.193570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.193968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.265145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.274012 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8cba8b26-e041-41a1-b390-909006431cdb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.152910 Oct 06 08:17:29.274589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 265/516] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:29 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:29.326732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.329150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:29.335457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:29.336073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:29.336523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.337990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.339182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e78c538a-702d-49de-8f80-c89daebf527e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.159323 Oct 06 08:17:29.339738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 252/517] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:29 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:29.342010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.342492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.342923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.343638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.344087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.344605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.373520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:29.374127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:29.381000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.381539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.382220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.382906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:29.383375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:29.383792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:29.475186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.482841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7dea9dc6-ad34-47f2-b26b-402629f8a852 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.152587 Oct 06 08:17:29.483446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 266/518] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:29 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:29.511971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:29.520060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c33913a2-72e8-42e0-b191-58c640f79ad2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.150362 Oct 06 08:17:29.520613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 253/519] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:29 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:30.296604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:30.297201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:30.299057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:30.302691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=16 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:30.304981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.305461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.305892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.306566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.307042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.307458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.365530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:30.366206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:30.373141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.373602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.374107 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.375372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.376021 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.376583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.447715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.455327 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9144562d-076e-4a7b-9389-a32e7a34b75f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.162571 Oct 06 08:17:30.456026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 267/520] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:30 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:30.505721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:30.506495 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:30.512296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.512747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.513239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.513676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.514372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.514829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.515282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.520300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.522526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.523776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b94aebdc-42e2-404e-9684-f49c0fd62be2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.162601 Oct 06 08:17:30.524405 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 254/521] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:30 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:30.542787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:30.543434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:30.549293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.549774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.550212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.550899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:30.551379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:30.551800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:30.648205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.650349 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:30.656578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4b78f576-a5a1-402f-859f-7af07fd21c21 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.154850 Oct 06 08:17:30.657168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 268/522] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:30 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:30.682124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:30.690404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a1c9d279-6235-4f11-b923-b54dc79b4b3a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.151333 Oct 06 08:17:30.690987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 255/523] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:30 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:31.480683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:31.481336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:31.488340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.488824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.489259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.491225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.491688 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.492223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.549632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:31.550239 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:31.558734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.559421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.560042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.560814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.561288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.561579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.649963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.661108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-042458b3-39c5-45f0-80e8-b1c121fb6dab tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.184918 Oct 06 08:17:31.669219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 269/524] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:31 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:31.680576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:31.681557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:31.687699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.688192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.688725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.689456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.689911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.690483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.723877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.735897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.741266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.743115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-35031198-4ad4-4a11-88df-53338d3dae74 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.197320 Oct 06 08:17:31.744461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 256/525] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:31 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:31.749495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:31.750709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:31.763273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.764054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.764714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.766035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:31.766702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:31.767571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:31.832550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.843175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-41dd1b96-a361-4f20-aa6f-994531b28b18 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.167093 Oct 06 08:17:31.843738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 270/526] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:31 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:31.932306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:31.941024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3cebadd0-14ee-49da-8f7d-8f2c43a247c5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.195327 Oct 06 08:17:31.941607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 257/527] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:31 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:32.684665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:32.685980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:32.703236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:32.703511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:32.704147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:32.704938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:32.705386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:32.705815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:32.770434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:32.771952 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:32.783515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:32.783515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:32.783515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:32.783515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:32.783999 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:32.783999 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:32.980139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:32.991423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:32.992874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:32.994081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b6893806-77bc-40e3-83bc-2da0fa2efb5a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.228116 Oct 06 08:17:32.995174 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 258/528] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:32 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:33.000671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:33.001480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:33.008092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:33.009601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:33.010273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:33.011296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:33.011953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:33.012832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:33.144858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:33.161051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3fdfe7bf-ae2a-459e-a25c-2bec21fe288d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1367 microversion: 2.1 time: 0.480211 Oct 06 08:17:33.166666 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 271/529] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:32 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1367 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:33.171955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:33.178738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:33.179568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:33.186619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-de397435-2c3e-4164-8310-7e32bce4b01e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.190205 Oct 06 08:17:33.187901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 259/530] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:32 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:33.204393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:33.204918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:33.205455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:33.206244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:33.206975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:33.207156 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:33.401912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:33.415611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-36848f81-c132-4e15-aba0-57f30efc0b0d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.247477 Oct 06 08:17:33.430902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 272/531] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:33 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:34.021281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:34.022636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:34.029791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.030434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.030912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.031634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.032270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.032701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.188259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.201136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:34.203254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:34.212312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.215844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.220945 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.224541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-455595b1-eadc-4637-9713-0e89de4931d1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.206653 Oct 06 08:17:34.225335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.225862 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.226656 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.227210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.227908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 260/532] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:34 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:34.228399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.237265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:34.237961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:34.249431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.250036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.250556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.251350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.251869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.252361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.399834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.412552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f77da278-9930-4e23-9a7c-5baf4ebc3405 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1557 microversion: 2.1 time: 0.226831 Oct 06 08:17:34.414879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 273/533] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:34 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1557 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:34.442474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:34.443507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:34.449576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.450078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.450205 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.451434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.452524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.452989 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.453421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.458644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4a023d08-991d-4f4b-89e1-419fa3b7ea64 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.229079 Oct 06 08:17:34.459292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 261/534] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:34 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:34.473021 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:34.473514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:34.480740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.481232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.481667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.482360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:34.482807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:34.483256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:34.573323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-aa83c2ab-4456-4dcc-a649-236da1fa24fd tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112895 Oct 06 08:17:34.574401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 262/535] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:17:34 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:34.909761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:34.918488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-18af83f9-080b-4eba-b13d-98157fbf3bc4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.483235 Oct 06 08:17:34.919089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 274/536] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:34 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:35.260031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:35.265409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:35.285361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.285976 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.287098 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:35.287951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.288364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.288796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:35.485843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:35.486809 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:35.494151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.495009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.495695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:35.496747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.497440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.498224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:35.641899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:35.662525 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:35.666491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:35.667735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-12513bf7-edfd-418e-b249-b2771706da54 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.416991 Oct 06 08:17:35.682124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 263/537] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:35 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:35.723646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:35.734304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e39df964-9da5-42ef-bf72-fb447355ba77 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.251977 Oct 06 08:17:35.735580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 275/538] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:35 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:35.944045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:35.944693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:35.952133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.952772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.953223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:35.954909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:35.954909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:35.954909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.152103 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eb0dfcf-fa42-40d8-b33c-b143432d90ad", "tag": "bae8df64-50c3-4330-a9c1-a7d4846124b1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:36.173023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:36.173825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:36.174488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.200949 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] Creating event network-changed:bae8df64-50c3-4330-a9c1-a7d4846124b1 for instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad on hv-cinder-86021 Oct 06 08:17:36.205157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:36.208995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-d6302578-d5b6-4c4f-b2ae-3eabe07e4fa0 req-0f7452af-438f-4f7c-86e2-2e768146fb44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063827 Oct 06 08:17:36.209961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 276/539] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:36.214979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d7b69ce9-c237-483a-9402-7cab8d8c8a4d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.274823 Oct 06 08:17:36.218987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 264/540] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:35 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:36.705473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:36.708298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:36.718822 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:36.720031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:36.720849 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.721678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:36.722376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:36.723059 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.762072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:36.762918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:36.784722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:36.785684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:36.787454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.788560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:36.790030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:36.796682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:36.987084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:37.008236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:37.016626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5ad9b7ea-aaf5-46aa-bf7c-73966e68751f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.262564 Oct 06 08:17:37.017465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:37.019284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:37.026086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f5e319cd-3cf8-46b1-8873-59412c638221 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.324923 Oct 06 08:17:37.027001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 277/541] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:36 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:37.027398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 265/542] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:36 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:37.240550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:37.243663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:37.252035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:37.253081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:37.253761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:37.254733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:37.255515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:37.257254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:37.466029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:37.476499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6d864008-df0c-482f-baff-d2e3cc1ca31f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.241033 Oct 06 08:17:37.494017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 278/543] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:37 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:38.043485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:38.044838 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:38.054263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:38.055609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:38.063904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.065789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.066393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.067172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.069034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.070193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.071190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.071608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.072286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.072974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.073625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.074308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.245436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:38.245752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:38.254976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:38.262976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:38.262976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2b51b97a-3f9d-4f87-a5be-02f4b774a85e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.208461 Oct 06 08:17:38.262976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 279/544] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:38 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:38.272106 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-67d64f40-2521-4090-b997-eaba523f2d9b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.231448 Oct 06 08:17:38.286968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 266/545] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:38 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:38.502663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:38.503303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:38.511168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.511672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.512114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.512823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:38.513279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:38.513711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:38.696135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:38.707698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a3c50a82-029e-4e85-a2f9-acbdef36c453 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.208847 Oct 06 08:17:38.708841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 280/546] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:38 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:39.285245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:39.285832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:39.296652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:39.297275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:39.298138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.298916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.300331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.316811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.316811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.316811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.317111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.317111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.317111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.317111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.317437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.317437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.464940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:39.478024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:39.480438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:39.481888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2785c743-65c2-4420-a2cb-9a16fd703132 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.200642 Oct 06 08:17:39.499610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 267/547] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:39 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:39.512101 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:39.520320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-886db537-0721-4de7-abed-b17e9698038e tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.227673 Oct 06 08:17:39.521616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 281/548] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:39 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:39.731625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:39.732148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:39.738675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.739644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.740257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.741013 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:39.741593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:39.742091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:39.919978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:39.929160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7c5f9604-9ed4-4fd8-b1f5-961b1e49aa1b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.201468 Oct 06 08:17:39.945866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 268/549] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:39 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:40.512858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:40.513721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:40.528126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.528629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.529065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:40.529772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.530294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.530721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:40.545990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:40.547190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:40.561857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.562678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.564738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:40.566203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.566812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.567482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:40.718768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:40.732932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:40.736538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:40.739038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7f1a8f68-4fab-4f13-98a6-a9fadd475acf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.231915 Oct 06 08:17:40.743982 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 282/550] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:40 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:40.772356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:40.774532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:40.783480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-83ccf759-9fff-48f5-a08e-ba2aa73499ac tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.239535 Oct 06 08:17:40.785356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 269/551] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:40 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:40.953917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:40.954520 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:40.965758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.966254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.966690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:40.967437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:40.968065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:40.968646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:41.126669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:41.138072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-df7cc694-fcdd-43bb-92c4-727dac22d6df tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.188612 Oct 06 08:17:41.147331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 283/552] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:40 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:41.775600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:41.776349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:41.789635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:41.790183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:41.790624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:41.793603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:41.794310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:41.794790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:41.809923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:41.810659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:41.817278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:41.817824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:41.818276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:41.819010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:41.819505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:41.820707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:41.975470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:41.985262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:41.986808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:41.988115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-08c41a73-1331-4e91-8f46-e4fc9d10dc64 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.222326 Oct 06 08:17:41.989083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 270/553] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:41 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:42.024677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:42.027127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e051c123-37fb-435d-90c1-b641683904cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.221424 Oct 06 08:17:42.027704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 284/554] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:41 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:42.173797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:42.174580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:42.185271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:42.185836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:42.186353 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:42.187203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:42.188276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:42.188710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:42.335652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:42.344169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4af9eee2-d13f-4d39-8e87-8eaa0da5f4f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.175064 Oct 06 08:17:42.344813 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 271/555] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:42 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:43.014093 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:43.014710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:43.022067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.022547 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.022999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.023699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.024146 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.024562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.049743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:43.050537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:43.058436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.059159 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.059852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.060667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.061253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.061780 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.170722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:43.179455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:43.180912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:43.182129 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-178f689e-7b4b-461a-b7a3-c9e504852dc5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.172020 Oct 06 08:17:43.182694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 285/556] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:43 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:43.210256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:43.217903 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-04020938-3f97-4608-8a42-44f07d6e71ff tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.172141 Oct 06 08:17:43.218476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 272/557] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:43 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:43.367771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:43.368378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:43.374338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.374818 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.375286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.375970 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:43.376419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:43.376834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:43.381097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:43.510836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:43.519282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae46d1f4-1ac2-42a0-9f9e-4431b4abbc49 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.156511 Oct 06 08:17:43.519840 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 286/558] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:43 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:44.208155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:44.210347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:44.215980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.216482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.216954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.217644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.218094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.218568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.240881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:44.241472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:44.247861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.248343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.250322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.251143 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.251613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.252046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.347678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:44.356127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:44.357579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:44.358720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-86be93b9-1dfe-45a8-a774-7fad80d043b8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.154735 Oct 06 08:17:44.359305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 273/559] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:44 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:44.383773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:44.391826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-91badebe-d21e-495f-9084-6942ef3afc40 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.154858 Oct 06 08:17:44.392483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 287/560] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:44 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:44.543216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:44.543850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:44.550267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.550747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.551205 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.552500 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:44.553532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:44.553939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:44.685755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:44.694513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ce81259b-ba91-433d-aaa4-5392064579a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.155343 Oct 06 08:17:44.695094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 274/561] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:44 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:45.385797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:45.386415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:45.392995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.398142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.398142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.398142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.398142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.398557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.415506 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:45.416108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:45.423195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.423689 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.424128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.424868 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.425327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.425823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.530830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:45.540842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:45.542464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:45.543732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8b6f3e5f-f527-467a-b09e-7022c7492705 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.162389 Oct 06 08:17:45.544294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 288/562] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:45 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:45.567175 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:45.575543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-17244be0-3c05-4a05-91be-051966da6bd5 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.164864 Oct 06 08:17:45.576105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 275/563] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:45 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:45.717563 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:45.718065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:45.724015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.724492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.724919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.725596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:45.726043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:45.726462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:45.855500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:45.863800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0999f539-0fbd-4352-aaac-d56a9ecdcd79 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.150243 Oct 06 08:17:45.864394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 289/564] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:45 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:46.569039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:46.569641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:46.576455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.578736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.578736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:46.578736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.578736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.579127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:46.600161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:46.600773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:46.607198 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.607683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.608117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:46.608803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.609253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.609674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:46.713870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:46.722121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:46.723609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:46.725488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-99a9ce3c-d750-46c5-adc6-b42129f9402f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.160749 Oct 06 08:17:46.726046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 276/565] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:46 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:46.738751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:46.746745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d2f768a9-c02e-432e-88b2-0197656a9a26 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.151740 Oct 06 08:17:46.747328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 290/566] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:46 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:46.887346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:46.887954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:46.893815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.894298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.894732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:46.895437 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:46.896615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:46.897016 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:47.023031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:47.031164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1ac01581-d655-4b07-a524-46ef99f33652 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.147614 Oct 06 08:17:47.031731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 277/567] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:46 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:47.750507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:47.751144 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:47.759000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:47.759522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:47.759960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:47.760659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:47.761130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:47.761556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:47.769686 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:47.770285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:47.776644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:47.777125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:47.777557 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:47.778235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:47.778677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:47.779132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:47.906879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:47.914149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:47.915654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:47.916834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-80182580-c3ab-4687-a65c-38a9be06bbbd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.170341 Oct 06 08:17:47.917399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 291/568] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:47 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:47.926169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:47.935293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-70cf7222-159b-4b75-81bd-de431157d447 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.169378 Oct 06 08:17:47.935953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 278/569] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:47 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:48.054676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:48.055307 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:48.061222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.072759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.072759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:48.072759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.072759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.073138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:48.212039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:48.220681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-488078e8-f3c7-4917-9775-97deaf6504a5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1722 microversion: 2.1 time: 0.170721 Oct 06 08:17:48.221855 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 292/570] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:48 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:48.945919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:48.945919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:48.947944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=94 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:48.954576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.955093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.955532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:48.956234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.956690 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.957114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:48.958275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:48.958740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:48.965444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.965967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.966397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:48.967113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:48.967644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:48.968031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.103321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.120756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.122310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.122986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.123508 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dc5e2f5e-7f36-4f46-a464-e5e3af0b5c78 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1739 microversion: 2.20 time: 0.183849 Oct 06 08:17:49.124070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 279/571] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:48 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:49.132822 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-67fe7adf-1705-41b3-b695-438207ec1a66 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.178498 Oct 06 08:17:49.133395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 293/572] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:48 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:49.245941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:49.246880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:49.252834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:49.253616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:49.254236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.265940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:49.265940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:49.265940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.388887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.397269 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e2ae639d-04c3-4f87-a085-2a70e636d304 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1699 microversion: 2.1 time: 0.155186 Oct 06 08:17:49.397835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 280/573] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:49 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:49.419868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:49.425921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:49.429390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:49.429390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.493281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Going to try to start instance {{(pid=121077) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 08:17:49.636229 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-63ebd5da-f7d3-4e81-95a8-48a922d79bbc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action" status: 202 len: 0 microversion: 2.1 time: 0.220075 Oct 06 08:17:49.636953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 294/574] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:17:49 2022] POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:17:49.645300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:49.646182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:49.652283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:49.652775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:49.653239 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.654127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:49.654579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:49.655042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:49.790773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:49.799462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ef9190bc-8c2d-4d22-aff5-c3b520086e92 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1708 microversion: 2.1 time: 0.157910 Oct 06 08:17:49.800231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 281/575] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:49 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:50.155981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:50.157133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:50.158696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:50.164515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:50.169924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.170612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.171081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.171239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.171820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.171924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.172277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.172439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.172698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.173263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.173782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.174264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.308576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:50.309734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:50.316643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9f2b4cab-b8eb-4640-87f4-185db5c8c58b tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.164944 Oct 06 08:17:50.317772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 282/576] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:50 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:50.318363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:50.320108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:50.321373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-297ef3fe-60ed-4e5a-bc64-574e48980282 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1721 microversion: 2.20 time: 0.175214 Oct 06 08:17:50.321924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 295/577] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:50 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:50.822739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:50.823397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:50.829481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.829970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.830412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.831136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:50.831597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:50.832024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:50.960745 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:50.969587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-594e6f98-c45b-42d9-8984-acf57c1e1141 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1708 microversion: 2.1 time: 0.150787 Oct 06 08:17:50.970157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 283/578] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:50 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:51.009647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:51.010139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:51.016207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.016687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.017119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.017801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.018254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.018681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.150261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lazy-loading 'services' on Instance uuid 7155ccf6-8eee-45e0-919e-a7dd514d59d9 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:17:51.339091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:51.339703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:51.346160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.346646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.351554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.351554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.351554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.351554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.408759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0c889c0f-eb6c-414d-9f54-96ab01709b91 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9/os-volume_attachments/84c8690b-075a-4dce-ac01-9f499fae4f60" status: 202 len: 0 microversion: 2.1 time: 0.404140 Oct 06 08:17:51.409664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 296/579] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:17:51 2022] DELETE /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9/os-volume_attachments/84c8690b-075a-4dce-ac01-9f499fae4f60 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:17:51.420757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:51.421541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:51.428552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.429038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.429691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.430391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.430845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.431354 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.486714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:51.496970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-660ac2fa-8191-406c-afe7-4b3501b3b433 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.161675 Oct 06 08:17:51.497560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 284/580] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:51 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:51.584693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:51.592991 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:51.594431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:51.595618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9c1c8e44-a2c7-426c-a18b-b9655eb5fb55 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1721 microversion: 2.20 time: 0.184978 Oct 06 08:17:51.596188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 297/581] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:51 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:51.679915 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f9a5b6-299d-401b-8fb4-228aafc743c0", "name": "network-vif-plugged", "status": "completed", "tag": "591be2db-72cd-443f-98f5-b22af346e6e4"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:51.689392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:51.689862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:51.694740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:51.703002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] Creating event network-vif-plugged:591be2db-72cd-443f-98f5-b22af346e6e4 for instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 on hv-cinder-86021 Oct 06 08:17:51.708252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-9b6203bb-6b91-406c-ad1d-ca17d72e5d57 req-3a2d93b1-5d45-40e2-bfb0-5301294801df service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Oct 06 08:17:51.708898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 285/582] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:51.997208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:51.997208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:52.002076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.002680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.003166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.003851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.004298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.004713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.159321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:52.168686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d6e60c89-1a23-4ead-9aed-b5277e4ed6c3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1708 microversion: 2.1 time: 0.180554 Oct 06 08:17:52.169202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 298/583] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:51 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:52.530602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:52.531522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:52.541837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.545113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.545677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.546477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.547278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.547789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.626100 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:52.627330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:52.637859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.638150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.638734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.639736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.639900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.640317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.696959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:52.705347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d9e30fb3-6469-4d45-850e-b85f8a8d27e4 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.181414 Oct 06 08:17:52.706074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 286/584] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:52 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:52.815079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:52.823848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:52.825387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:52.826534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-34b1ca38-a4b0-46eb-9779-e16512f2ce81 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1724 microversion: 2.20 time: 0.208737 Oct 06 08:17:52.827116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 299/585] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:52 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:52.851430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f708138-af08-468b-b82f-373e32a7e9a8"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:52.853728 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:52.859558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.861368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.861368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.861368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:52.861633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:52.861953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:52.866449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:53.191758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:53.192408 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:53.203761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.212800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.212800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.212800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.212800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.213200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.340874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:53.349764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f0fd7f01-f44a-4541-951f-fefd5ca73c7e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1708 microversion: 2.1 time: 0.161930 Oct 06 08:17:53.350338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 300/586] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:53 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1708 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:53.684266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:53.684929 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:53.690849 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.691385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.691822 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.692581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.693073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.693528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.696299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:53.723199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:17:53.900569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ff071a13-ab7b-417f-bea3-2a6497fafcba tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.053442 Oct 06 08:17:53.904869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 287/587] 10.222.0.30 () {62 vars in 1364 bytes} [Thu Oct 6 08:17:52 2022] POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:17:53.905832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "name": "network-vif-unplugged", "status": "completed", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:53.916560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.917081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.917471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.929809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] Creating event network-vif-unplugged:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:17:53.934775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-fc48d283-f031-4ada-abc8-ca42d5464f51 req-8b0fda1b-ceaf-4fba-a6a9-a758553208a5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032391 Oct 06 08:17:53.935461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 288/588] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:17:53.940533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:53.941229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:53.948169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.955574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.955574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:53.955574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:53.955574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:53.955988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.009934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae8789a4-cf5f-42ae-aaa2-d327af0cd602 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 204 len: 0 microversion: 2.1 time: 0.329393 Oct 06 08:17:54.010732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 301/589] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:17:53 2022] DELETE /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:17:54.020969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:54.021742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:54.029197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.029677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.031260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.031260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.031260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.031713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.091953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.099699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9fba9104-5140-4de4-9433-e483bda307da tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.163146 Oct 06 08:17:54.103782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 289/590] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:53 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:54.104927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:17:54.105534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:54.111634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.112109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.112536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.113398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.113997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.114684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.164153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121076) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 08:17:54.187358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.196232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f9d8fac2-ee5c-48b1-a052-12be15d6d049 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1559 microversion: 2.1 time: 0.181254 Oct 06 08:17:54.201511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 302/591] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:54 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:54.373907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:54.374552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:54.381775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.382548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.383331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.383886 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.384343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.384760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.522860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.531823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-47ad66fc-6fe5-44e4-bf7a-f0060af296ca tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1712 microversion: 2.1 time: 0.162116 Oct 06 08:17:54.537497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 303/592] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:54 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1712 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:54.544990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9bf3a8d4-9c9d-4209-8560-0b7a97b40e9c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/action" status: 202 len: 0 microversion: 2.20 time: 0.443609 Oct 06 08:17:54.548655 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 290/593] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Oct 6 08:17:54 2022] POST /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:17:54.557829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:54.558765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:54.567562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.568136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.568747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.569456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:54.570031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:54.570543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:54.706918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.716562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.718115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:54.719382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-92308a2a-47ea-472f-a160-25a641e8faff tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.167705 Oct 06 08:17:54.720029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 304/594] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:54 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:55.123384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:55.124076 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:55.132706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.132706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.132706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.132706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.133211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.133211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.219382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:55.219999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:55.229940 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.230874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.231523 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.232514 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.232673 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.233094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.281839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:55.291528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-74745c43-66e0-410c-8ee3-82885293d167 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1314 microversion: 2.1 time: 0.172202 Oct 06 08:17:55.294738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 291/595] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:55 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:55.377370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:55.387539 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-429a61cb-270d-4fcf-9e79-03caa6bed325 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1513 microversion: 2.1 time: 0.171921 Oct 06 08:17:55.394234 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 305/596] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:55 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:55.745546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:55.746177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:55.752863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.753339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.753763 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.754439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:55.754882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:55.755327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:55.890400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:55.899472 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:55.900893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:55.902027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-378bf230-a834-4884-9a26-0de1fd6dc9b7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.160321 Oct 06 08:17:55.902575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 292/597] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:55 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:17:56.314712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:56.315385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:56.322288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.322768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.323244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.323928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.324382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.324806 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.409567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:56.410103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:56.416272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.416759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.417189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.417872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.418319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.418744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.451117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:56.458866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a6d7f68d-0689-4bfb-b18a-2064934ecd46 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1464 microversion: 2.1 time: 0.148034 Oct 06 08:17:56.459466 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 306/598] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:56 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:56.504922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:56.505494 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:56.514773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.515286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.515718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.516401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.516850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.517266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.542768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:17:56.553780 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:56.561580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7299ef6e-201c-4d54-ad9f-808d541b264b tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1513 microversion: 2.1 time: 0.155854 Oct 06 08:17:56.562238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 293/599] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:56 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:56.787167 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-bb632894-b82c-4000-9689-056063e3a949 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 204 len: 0 microversion: 2.1 time: 0.285289 Oct 06 08:17:56.787924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 307/600] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:17:56 2022] DELETE /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:17:56.796129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:56.796762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:56.803954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.804432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.804861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.805567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.806012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.806431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.929032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:56.929715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:56.935552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.936031 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.936460 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.937138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:56.937590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:56.938020 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:56.938819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:56.946995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-110688ac-df75-4bc0-98e7-4da553cf331d tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1470 microversion: 2.1 time: 0.154665 Oct 06 08:17:56.947588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 294/601] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:56 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:57.079589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:57.088788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:57.090262 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:57.091486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-03e67bf1-d6b1-41cb-8652-acea19e651a7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.167542 Oct 06 08:17:57.092055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 308/602] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:56 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:57.585414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:57.586014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:57.591887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:57.592368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:57.592794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:57.593470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:57.593916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:57.594332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:57.720688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:57.728532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-40dec16b-a1b8-4d8e-b30e-8f422a39a6af tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1513 microversion: 2.1 time: 0.147603 Oct 06 08:17:57.729096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 295/603] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:57 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:57.970925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:57.971574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:57.974028 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:17:57.978824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:57.979360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:57.979798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:57.980480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:57.980931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:57.981351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:58.107777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:58.117096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2f23f3a3-dd2b-4d1e-8077-a5ca4816d876 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1470 microversion: 2.1 time: 0.149872 Oct 06 08:17:58.117811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 309/604] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:57 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:17:58.118288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:58.123050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:58.125488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:58.125977 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:58.126424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:58.127147 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:58.127634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:58.128061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:58.257082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:58.265884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:58.267420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:58.268565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9c1dea68-a671-4771-bbab-374870e60fd6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.154598 Oct 06 08:17:58.269132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 296/605] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:58 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:58.751492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:58.752102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:58.758490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:58.759011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:58.759449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:58.760232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:58.760712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:58.761136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:58.889789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:58.898554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-39392186-56f7-4b98-913e-793e83d5016f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1513 microversion: 2.1 time: 0.150856 Oct 06 08:17:58.899139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 310/606] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:58 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:59.141790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:59.142321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:59.149747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.150268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.150698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:59.151502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.151956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.152373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:59.283394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:59.291122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3618ac8e-eef2-4a61-bbd5-df12ad26491f tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1470 microversion: 2.1 time: 0.153238 Oct 06 08:17:59.292090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 297/607] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:59 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:17:59.293862 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:59.294486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:59.300939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.301423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.301859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:59.302586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.303110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.303532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:59.431278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:59.439881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:59.441301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:17:59.442444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ad23c132-b044-406d-bc99-2db71baeeaf8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.152605 Oct 06 08:17:59.443615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 311/608] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:17:59 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:17:59.921872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:17:59.922637 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:17:59.930701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.931228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.931662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:17:59.932355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:17:59.932834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:17:59.933255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.089022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:00.098379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-195b7f54-4277-4df3-825e-cd892b8d5e71 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1513 microversion: 2.1 time: 0.180366 Oct 06 08:18:00.115565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 298/609] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:17:59 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:00.313780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:00.314422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:00.321108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:00.321688 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:00.322130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.322831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:00.323337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:00.323788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.469029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:00.469565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:00.469852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:00.477509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:00.478176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:00.478606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8f619a7c-a42a-4358-b532-f9db5048e6cc tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1470 microversion: 2.1 time: 0.168797 Oct 06 08:18:00.478846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.479404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 312/610] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:00 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:00.479849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:00.480431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:00.480924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.590567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7155ccf6-8eee-45e0-919e-a7dd514d59d9", "name": "network-vif-deleted", "tag": "e9f3bf39-064b-4658-b472-6ee60d24dc92"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:00.600802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:00.601498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:00.602109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:00.615582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] Creating event network-vif-deleted:e9f3bf39-064b-4658-b472-6ee60d24dc92 for instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 on hv-cinder-86021 Oct 06 08:18:00.621919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-98f4f80c-c233-40a1-aa9a-e15a4067093b req-991c6acb-d71a-4bf3-a346-67b97c335fcf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034907 Oct 06 08:18:00.623372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 313/611] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:18:00.626194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:00.639607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:00.639842 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:00.640991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d1d57351-10c4-49ca-a7df-d2db4d6a2900 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1810 microversion: 2.20 time: 0.176180 Oct 06 08:18:00.641585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 299/612] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:00 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:01.125741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:01.126522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:01.151975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.152691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.153287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.154148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.155878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.156866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.201951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.202382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.202823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.203346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lazy-loading 'fault' on Instance uuid 7155ccf6-8eee-45e0-919e-a7dd514d59d9 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:18:01.252685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:01.254988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:01.263410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-294714c4-0cc0-4bd7-953b-83f1ac998d9e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 200 len: 1309 microversion: 2.1 time: 0.142326 Oct 06 08:18:01.279683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 314/613] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:01 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:01.502285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:01.507002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:01.511108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.511596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.512059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.512743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.513192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.513633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.577396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:01.580048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:01.587030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1a229f6d-548f-44fa-864f-40a402a67c32 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1299 microversion: 2.1 time: 0.089348 Oct 06 08:18:01.587694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 300/614] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:01 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:01.667725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:01.668249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:01.674983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.679094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.679094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.679094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:01.679094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:01.679479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:01.808722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:01.818966 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:01.820606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:01.822224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-24eaf88b-2d0c-419c-917d-c843779f8928 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1752 microversion: 2.20 time: 0.158955 Oct 06 08:18:01.822893 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 315/615] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:01 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:02.291491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:02.292098 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 7155ccf6-8eee-45e0-919e-a7dd514d59d9] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:02.299031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.299517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.299948 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.300626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.301079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.301498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.315808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] HTTP exception thrown: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Request method failure captured: Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 HTTP/1.1 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo6_lmQcmToVlfg5w7on-34S7sqv5J87O37BrVvT8dqkvn86J0IpvP9To1U970IS9d9xHj7y-nKeKk2UU53CJE6_DMe7TlzVpziNDMKCEQJEHLfp0I8PZDGRpLQbzQfD3oYKaAMzEEXi16Bf4U8RguZCyV0irDMxYy6sqTFw6PJmzjI Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 141863eb21404f229b8d624af2ff6743 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:18:02.317478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_141863eb21404f229b8d624af2ff6743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/141863eb21404f229b8d624af2ff6743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/141863eb21404f229b8d624af2ff6743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/141863eb21404f229b8d624af2ff6743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 141863eb21404f229b8d624af2ff6743 Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesSnapshotTestJSON-1171407741-project Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: fff5a88cba04475c9a0142156a2269f0 Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesSnapshotTestJSON-1171407741-project Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. Oct 06 08:18:02.319215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '7155ccf6-8eee-45e0-919e-a7dd514d59d9'} Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:18:02.320141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. Oct 06 08:18:02.321533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:18:02.322629 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Returning 404 to user: Instance 7155ccf6-8eee-45e0-919e-a7dd514d59d9 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:18:02.322629 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ad10f123-0c76-4a89-8ae1-9f48207c4978 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9" status: 404 len: 111 microversion: 2.1 time: 0.032771 Oct 06 08:18:02.322629 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 301/616] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:02 2022] GET /compute/v2.1/servers/7155ccf6-8eee-45e0-919e-a7dd514d59d9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:18:02.609078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:02.609682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:02.616510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.617006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.617470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.618157 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.618692 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.619141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.644101 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f9a5b6-299d-401b-8fb4-228aafc743c0", "name": "network-vif-deleted", "tag": "591be2db-72cd-443f-98f5-b22af346e6e4"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:02.656927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.657395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.657605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.657822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.658254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.659067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.659541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lazy-loading 'fault' on Instance uuid b7f9a5b6-299d-401b-8fb4-228aafc743c0 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:18:02.677165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] Creating event network-vif-deleted:591be2db-72cd-443f-98f5-b22af346e6e4 for instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 on hv-cinder-86021 Oct 06 08:18:02.684761 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-d8b88fc3-4971-4787-bdea-4f20e9b4d0b8 req-a6242218-2d0e-44e0-8dd5-4592a426a91f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044458 Oct 06 08:18:02.685450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 302/617] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:18:02.711672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d2a46971e1e459e92fabdc8a5c54d10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35d7501875734ba1a41351b2ac57db09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:02.721360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-aa2b018f-b429-4092-a4f5-df2068240968 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 200 len: 1304 microversion: 2.1 time: 0.116015 Oct 06 08:18:02.722060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 316/618] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:02 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:02.853758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:02.854444 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:02.860929 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.861403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.861835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.862510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:02.862983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:02.863404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:02.998120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:03.006707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:03.008540 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:03.010274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5b1e4473-a322-4cf2-9de0-67c06fd062fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1752 microversion: 2.20 time: 0.161683 Oct 06 08:18:03.011117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 303/619] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:02 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:18:03.745942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:03.746645 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] [instance: b7f9a5b6-299d-401b-8fb4-228aafc743c0] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:03.753108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:03.753622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:03.754061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:03.754759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:03.755245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:03.756196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:03.769833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] HTTP exception thrown: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Request method failure captured: Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 HTTP/1.1 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo8MxyHJb1QlmretRd2hh3ZHcGzLD_hUlv0UofH_hkkpCz7RLzSC49KcCN6l2Y6RzZkwb_EExJytIM6NE3OjB2LIzPsYzcNPZqtNouDAu-kBMsjtou96SUMJm2mh3hbWOmGSMiF_mYyqD4oJt6mknQ9-3fNvEBagSeezK-2XcHuYaDM Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 35d7501875734ba1a41351b2ac57db09 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesNegativeTest-1001340506 Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:18:03.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_35d7501875734ba1a41351b2ac57db09"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35d7501875734ba1a41351b2ac57db09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/35d7501875734ba1a41351b2ac57db09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/35d7501875734ba1a41351b2ac57db09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesNegativeTest-1001340506 Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 35d7501875734ba1a41351b2ac57db09 Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesNegativeTest-1001340506 Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesNegativeTest-1001340506-project Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 2d2a46971e1e459e92fabdc8a5c54d10 Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesNegativeTest-1001340506-project Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. Oct 06 08:18:03.773562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'b7f9a5b6-299d-401b-8fb4-228aafc743c0'} Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:18:03.774531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. Oct 06 08:18:03.776032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:18:03.777284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] Returning 404 to user: Instance b7f9a5b6-299d-401b-8fb4-228aafc743c0 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:18:03.777284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ddd06a6d-aedd-418a-b283-67d1470f9fe3 tempest-VolumesNegativeTest-1001340506 tempest-VolumesNegativeTest-1001340506-project] 10.222.0.30 "GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0" status: 404 len: 111 microversion: 2.1 time: 0.031568 Oct 06 08:18:03.777284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 317/620] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:03 2022] GET /compute/v2.1/servers/b7f9a5b6-299d-401b-8fb4-228aafc743c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:18:04.035368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:04.035965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:04.042609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:04.043196 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:04.043642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:04.044333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:04.044781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:04.045201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:04.189744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:04.198399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:04.199853 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:04.200989 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-17c65568-9e36-4a62-9a7b-7c333e523628 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.169503 Oct 06 08:18:04.201548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 304/621] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:04 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:05.225983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:05.226631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:05.239599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:05.239599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:05.239599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:05.239599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:05.240051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:05.240051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:05.369907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:05.378401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:05.379868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:05.381240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6fcc2eac-d4b3-498e-bb31-f29fcf0f408f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.159447 Oct 06 08:18:05.381791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 318/622] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:05 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:06.407478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:06.408083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:06.414681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:06.415204 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:06.415669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:06.416352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:06.416800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:06.417217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:06.554250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:06.564891 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:06.566328 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:06.567499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4f61bc53-2701-4227-8cbd-3111e754accd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.164192 Oct 06 08:18:06.568068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 305/623] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:06 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:07.594902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:07.596687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:07.603573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:07.604061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:07.604498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:07.605199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:07.605664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:07.606090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:07.832646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:07.839151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:07.840584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:07.842733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-199dc52e-5d00-4ce0-b4e5-8246b878eec8 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.251917 Oct 06 08:18:07.855502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 319/624] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:07 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:08.871488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:08.872809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:08.881740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:08.882247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:08.885325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:08.885325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:08.885325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:08.885325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:09.032703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:09.042500 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:09.043975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:09.045150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-09988faa-c5d5-498d-ae9d-64895dd01189 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.180688 Oct 06 08:18:09.045715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 306/625] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:08 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:10.073944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:10.075534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:10.082398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:10.083135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:10.083755 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:10.084639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:10.085736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:10.086174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:10.523670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:10.532318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:10.533736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:10.534889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-24364212-96ac-4530-a14b-9e2fd06db082 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.466136 Oct 06 08:18:10.535495 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 320/626] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:10 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:11.561030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:11.561780 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:11.569192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:11.569512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:11.570120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:11.571119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:11.571550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:11.571927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:11.709103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:11.718468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:11.719950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:11.721104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6cdf2a6c-d88d-43f6-9bf7-d4c6b200e281 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.164549 Oct 06 08:18:11.721665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 307/627] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:11 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:12.746177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:12.746784 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:12.753390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:12.757455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:12.757455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:12.757455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:12.757455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:12.758098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:12.912115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:12.924227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:12.925820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:12.927389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-de840b71-d36f-4ae3-bd95-54237c009dd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.185558 Oct 06 08:18:12.928043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 321/628] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:12 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:18:13.955749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:13.956374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:13.963874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:13.964360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:13.964797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:13.965488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:13.965941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:13.966372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:14.097845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:14.106615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:14.121751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:14.121751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f855ec2d-1b13-40c0-b481-2795b7b413cf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.157493 Oct 06 08:18:14.121751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 308/629] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:13 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:15.157424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:15.159798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:15.168725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:15.169672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:15.171127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:15.172114 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:15.172953 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:15.173892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:15.325438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:15.335457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:15.337057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:15.339424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cd9c731f-1f9e-4664-88e3-d692733bbc8a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.193570 Oct 06 08:18:15.340202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 322/630] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:15 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:16.366103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:16.366812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:16.374079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:16.374581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:16.375034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:16.375727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:16.376178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:16.376662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:16.503013 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:16.511769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:16.513211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:16.514358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7eb6aedb-6e65-40ad-91b1-460082634a8f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.152186 Oct 06 08:18:16.514913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 309/631] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:16 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:17.539630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:17.540251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:17.546903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:17.547420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:17.547856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:17.548553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:17.549004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:17.549425 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:17.700617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:17.710424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:17.712466 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:17.714001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6f79a2b0-51c4-4ef3-9ba0-ed8360f219fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.178313 Oct 06 08:18:17.727387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 323/632] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:17 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:18.122168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-366823310", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "networks": [{"uuid": "13ee70c1-b283-4e47-bd71-1df0f98884c9"}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:18.197229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] validate_networks() for [('13ee70c1-b283-4e47-bd71-1df0f98884c9', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:18:18.557448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:18:18.557961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:18:18.558509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:18:18.559929 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:18:18.560440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:18:18.570336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:18.570902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:18.571437 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:18.572310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:18.573019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:18.573511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:18.592850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Getting quotas for project 141863eb21404f229b8d624af2ff6743. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:18:18.597431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Getting quotas for user fff5a88cba04475c9a0142156a2269f0 and project 141863eb21404f229b8d624af2ff6743. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:18:18.609679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:18:18.612105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:18:18.708882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a9387a0-a342-4636-99fb-7a7f53ff28b0 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590946 Oct 06 08:18:18.709438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 310/633] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:18:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:18:18.721098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0eea448e-ed2a-4b05-8bd3-e916f957ff9a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:18.721717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0eea448e-ed2a-4b05-8bd3-e916f957ff9a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:18.743278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:18.744067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:18.752289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:18.752884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:18.753324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:18.754079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:18.754532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:18.755028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:18.817687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0eea448e-ed2a-4b05-8bd3-e916f957ff9a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:18.835397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0eea448e-ed2a-4b05-8bd3-e916f957ff9a tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1218 microversion: 2.1 time: 0.118186 Oct 06 08:18:18.839938 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 324/634] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:18 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1218 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:18.938305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:18.947872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:18.950127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:18.951333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3f6696b6-68a3-4241-98e4-224ba4bbebe0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.213408 Oct 06 08:18:18.951994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 311/635] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:18 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:19.867311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:19.867993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:19.879948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:19.880633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:19.881150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:19.882203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:19.882832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:19.883648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:19.964102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:19.974302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-550f69e9-ac3e-4d43-8a4b-a3bf3b732fce tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.115800 Oct 06 08:18:19.975155 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 325/636] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:19 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:19.980607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:19.981387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:19.985461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:19.990445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:19.991487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:19.992233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:19.993344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:19.994017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:19.994587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:20.140292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:20.150255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:20.153074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:20.153320 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-875ddb6d-0180-43e9-aa08-7b0271e16601 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.178761 Oct 06 08:18:20.153847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 312/637] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:19 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:21.001717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:21.004079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:21.011040 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:21.011758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:21.012375 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:21.013076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:21.013522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:21.013943 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:21.079027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:21.086922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-aa4f3ee6-a261-4e67-a442-b5032aa5b9e2 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.089033 Oct 06 08:18:21.087518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 326/638] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:20 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:21.178490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:21.183527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:21.186923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:21.187433 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:21.187875 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:21.188568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:21.189019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:21.189449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:21.378300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:21.378300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:21.378549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:21.378549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b7e9c716-d6a8-4a20-a504-68904eb1b866 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.164766 Oct 06 08:18:21.378549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 313/639] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:21 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:22.113556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:22.113556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:22.117710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:22.118197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:22.118633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:22.119351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:22.119804 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:22.120227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:22.189955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:22.198085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c08489cb-de74-432b-8f19-4795c1585202 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.092006 Oct 06 08:18:22.198660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 327/640] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:22 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:22.418618 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:22.419473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:22.426504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:22.427014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:22.427449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:22.428157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:22.428607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:22.429078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:22.565727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:22.574449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:22.576810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:22.578043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-064b61b0-c086-46ca-9ff4-8f76061e07c6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.163453 Oct 06 08:18:22.578871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 314/641] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:22 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:23.221219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:23.221820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:23.228273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:23.228746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:23.229172 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:23.229847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:23.230291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:23.230707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:23.456256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:23.463858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7d186a98-c674-4f73-8a71-db8bfc3871df tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.246576 Oct 06 08:18:23.464422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 328/642] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:23 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:23.604114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:23.604647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:23.611598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:23.612078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:23.612515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:23.613199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:23.613652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:23.614071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:23.743826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:23.754249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:23.755727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:23.756884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c94f4c7f-72f0-4f5f-b1fc-7a9287cf7611 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.156663 Oct 06 08:18:23.757438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 315/643] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:23 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:24.488046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:24.488660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:24.494794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:24.495308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:24.495747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:24.496436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:24.496891 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:24.497316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:24.559076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:24.566651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-db2eae0c-f635-4393-a170-98dd79f97871 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.082454 Oct 06 08:18:24.567274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 329/644] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:24 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:24.784700 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:24.785257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:24.791599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:24.792079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:24.792509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:24.793187 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:24.793630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:24.794046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:24.923124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:24.932848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:24.934299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:24.935496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9c0c13b0-46a9-43d9-a2f8-94e2611775d3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.157234 Oct 06 08:18:24.936153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 316/645] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:24 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:25.589051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:25.594398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:25.596728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:25.597208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:25.597635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:25.598311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:25.598757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:25.599197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:25.660591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:25.668110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4c468242-fef7-4c40-80ec-0b7188c9ea67 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.083000 Oct 06 08:18:25.668669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 330/646] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:25 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:25.961273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:25.961882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:25.968287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:25.968774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:25.969214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:25.970395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:25.970982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:25.971411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:26.149927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:26.159217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:26.160939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:26.162091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e43bc1b8-a44c-4cfd-a115-54e92291e5ac tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.204712 Oct 06 08:18:26.162656 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 317/647] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:25 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:26.691838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:26.692440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:26.698812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:26.699312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:26.699743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:26.700411 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:26.700857 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:26.701271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:26.761464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:26.769980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-015c105d-0203-4386-b0c5-3219eebd3081 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1222 microversion: 2.1 time: 0.082483 Oct 06 08:18:26.770553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 331/648] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:26 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:27.189454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:27.190061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:27.196144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:27.200102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:27.200102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:27.200102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:27.200102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:27.200459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:27.335345 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:27.344469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:27.347254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:27.348423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4b0b86cc-3532-499b-b1e5-d68525ad5920 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.165072 Oct 06 08:18:27.348984 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 318/649] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:27 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:27.792675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:27.793278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:27.801500 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:27.807075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:27.807075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:27.807075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:27.807075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:27.807414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:27.867458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:27.869608 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:27.875615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-08d5d55c-f86e-4608-99fc-382341745f9d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1270 microversion: 2.1 time: 0.087344 Oct 06 08:18:27.876803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 332/650] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:27 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:28.373652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:28.374256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:28.381122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:28.384142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:28.384142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:28.384142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:28.384142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:28.384536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:28.399097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:28.518411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:28.527299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:28.528774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:28.529924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f4636056-e180-44bc-a3b2-e53e8fef5f11 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.160265 Oct 06 08:18:28.530487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 319/651] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:28 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:28.901443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:28.902271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:28.904566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:28.905372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=54 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:28.910674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:28.911189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:28.911627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:28.912359 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:28.912808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:28.913317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:28.986841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:28.994628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-36d4c668-4a40-40bb-85dd-915ccc8c59a1 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1276 microversion: 2.1 time: 0.097512 Oct 06 08:18:28.997136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 333/652] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:28 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:29.556619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:29.557229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:29.559199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:29.559868 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=6 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:29.566189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:29.566934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:29.567462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:29.568162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:29.568620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:29.569042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:29.700309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:29.709920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:29.711375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:29.712528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-da8fe0a7-9487-4e57-a9f9-1668d84ce438 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.160254 Oct 06 08:18:29.713086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 320/653] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:29 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:30.020409 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:30.021323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:30.028346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:30.028821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:30.029252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:30.029943 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:30.030417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:30.030838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:30.299380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:30.306878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7ec67b11-fbac-4342-bc0a-b77678997d5c tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.291519 Oct 06 08:18:30.307472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 334/654] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:30 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:18:30.354585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b82770a-b5c6-4ab1-bac0-69738bb6498f", "tag": "2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:30.368109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:30.368109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:30.368109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:30.377204 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] Creating event network-changed:2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb for instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f on hv-cinder-86021 Oct 06 08:18:30.382962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-45dc83f8-750e-4bdf-9a96-511a233d96cc req-8b907322-20ad-4dbb-a833-579d8b90470d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032002 Oct 06 08:18:30.383983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 321/655] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:18:30.737948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:30.738641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:30.744661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:30.745239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:30.745736 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:30.746488 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:30.747038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:30.747458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:30.909257 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:30.918246 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:30.919708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:30.920854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-75204d8e-96fd-4683-92da-8a6e0c6c55a2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.186993 Oct 06 08:18:30.921629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 335/656] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:30 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:31.330431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:31.331159 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:31.337224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:31.340964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:31.340964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:31.340964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:31.340964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:31.341468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:31.475314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:31.482879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b51c920f-455f-436b-9936-c8791e0e90a8 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.157187 Oct 06 08:18:31.483480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 322/657] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:31 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:31.948630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:31.949237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:31.955944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:31.956420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:31.956854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:31.957534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:31.957980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:31.958398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:32.088774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:32.097739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:32.099222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:32.100364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-00f48401-0685-43fd-bb0f-d28150c6cd38 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.155668 Oct 06 08:18:32.100919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 336/658] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:31 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:32.506113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:32.506724 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:32.513464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:32.513946 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:32.514384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:32.515104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:32.515558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:32.515982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:32.649491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:32.656969 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9bde0662-b3c5-401b-a2dd-90435993c296 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.154791 Oct 06 08:18:32.657558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 323/659] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:32 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:33.125993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:33.126641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:33.134042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:33.137077 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:33.137515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:33.138276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:33.144223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:33.144223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:33.327555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:33.327555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:33.327848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:33.327848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-add440c6-b040-4fb5-899b-92cb942ee981 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.162479 Oct 06 08:18:33.327848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 337/660] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:33 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:33.680128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:33.680662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:33.687115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:33.687593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:33.688027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:33.689322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:33.689774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:33.690192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:33.816892 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:33.824475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f8ff46ed-453f-401e-8c6f-952bba2fc816 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.148309 Oct 06 08:18:33.825006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 324/661] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:33 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:34.311118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:34.311724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:34.318151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:34.318634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:34.319101 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:34.319785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:34.320235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:34.320658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:34.450406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:34.459057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:34.460499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:34.461656 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b1c26c14-99b1-407c-b17c-3dec5a141dfa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.154609 Oct 06 08:18:34.462209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 338/662] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:34 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:34.847742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:34.848357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:34.854834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:34.855346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:34.855773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:34.856460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:34.856907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:34.857324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:34.988446 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:34.996044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9c8c6553-fd8f-4978-bbfc-c2e080c0efba tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.152766 Oct 06 08:18:34.996603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 325/663] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:34 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:35.487026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:35.487635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:35.494070 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:35.494551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:35.495000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:35.499769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:35.499769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:35.499769 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:35.631253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:35.640371 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:35.645465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:35.645465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2effad7c-eac4-4235-acc8-44e4f94474fd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.160551 Oct 06 08:18:35.645465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 339/664] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:35 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:36.018740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:36.019399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:36.025667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:36.026142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:36.026572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:36.027280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:36.027726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:36.028142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:36.157524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:36.165496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7f491c1e-b531-4cae-819d-a0db8d4aab0d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.150913 Oct 06 08:18:36.166056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 326/665] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:36 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:36.670204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:36.670901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:36.680614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:36.681419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:36.682152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:36.683321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:36.684066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:36.684805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:36.834053 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:36.847588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:36.849724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:36.851661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-401ee421-6ad7-4e65-854f-d4728e715b1a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.186054 Oct 06 08:18:36.852967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 340/666] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:36 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:37.189680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:37.190458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:37.197025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:37.197516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:37.198665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:37.199617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:37.200078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:37.200532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:37.338158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:37.346442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8d4413df-ba2a-481d-96b7-680fe5f9193f tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.161338 Oct 06 08:18:37.347119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 327/667] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:37 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:37.856684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b82770a-b5c6-4ab1-bac0-69738bb6498f", "name": "network-vif-plugged", "status": "completed", "tag": "2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:37.866542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:37.867043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:37.867468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:37.878661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] Creating event network-vif-plugged:2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb for instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f on hv-cinder-86021 Oct 06 08:18:37.883917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-7055de52-68f6-48f1-ba49-a28b21802c6c req-1fb338f1-4128-4e1d-9d9b-84278fc42a8a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031864 Oct 06 08:18:37.884643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 341/668] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:18:37.884774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:37.885259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:37.891225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:37.891822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:37.892262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:37.893540 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:37.893993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:37.894414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:38.025444 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:38.034659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:38.036122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:38.037272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cb135c00-fec4-4813-98f7-1e5850e730ee tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.156791 Oct 06 08:18:38.037837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 328/669] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:37 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:18:38.370250 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:38.370976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:38.377099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:38.377582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:38.378015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:38.378697 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:38.379182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:38.379610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:38.559127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:38.566726 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e53b73ad-0b1a-4e7c-9970-f92a056c3a7d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.200739 Oct 06 08:18:38.567339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 342/670] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:38 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:39.171216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:39.171829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:39.178513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:39.179023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:39.179455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:39.180522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:39.180643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:39.181002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:39.308751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:39.317894 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:39.319368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:39.320503 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-883da743-e40d-4e88-bc96-5fba8a18ef24 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.261325 Oct 06 08:18:39.321054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 329/671] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:39 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:39.589294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:39.589925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:39.596805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:39.597278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:39.597706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:39.598378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:39.598825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:39.599275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:39.732536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:39.740986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4202bd47-80cc-40a8-8b53-0569dffbdcdc tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.155547 Oct 06 08:18:39.742694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 343/672] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:39 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:40.346121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:40.346694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:40.353313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:40.353796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:40.354228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:40.354912 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:40.355388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:40.355811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:40.481870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:40.491335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:40.492767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:40.493939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-db209225-9f4c-4302-9612-1e84360cc90a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.152211 Oct 06 08:18:40.494693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 330/673] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:40 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:40.764820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:40.768104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:40.768448 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 08:18:40.768599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Thu Oct 6 08:18:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f (ip 10.222.0.30) !!! Oct 06 08:18:40.774971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:40.775456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:40.775885 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:40.776565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:40.777009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:40.777426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:40.912215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:40.919993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f7f37a26-15bc-4a80-9fd0-6a85be990e61 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1318 microversion: 2.1 time: 0.158977 Oct 06 08:18:40.920566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 344/674] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:40 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:41.521403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:41.522009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:41.528412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:41.528888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:41.529318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:41.529995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:41.530442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:41.530857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:41.658384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:41.666782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:41.668235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:41.669389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8c6d2d0e-dc7d-449b-b88a-8d1a603dd2af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.151969 Oct 06 08:18:41.669938 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 331/675] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:41 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:41.942341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:41.942968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:41.949682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:41.950179 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:41.950612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:41.951335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:41.951796 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:41.952226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.090694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:42.099266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e2e93add-bcb9-44ba-bddc-1c0ae5e15471 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1507 microversion: 2.1 time: 0.160721 Oct 06 08:18:42.099829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 345/676] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:18:41 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:18:42.122847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1afdb03b-2d4a-418b-b60e-707bf2182c60", "device": "/dev/sdb"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:42.123596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "name": "network-vif-plugged", "status": "completed", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:18:42.125662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:42.132113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:42.132686 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:42.133194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.133836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:42.134145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:42.134306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:42.134596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:42.134723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.135036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.146518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] Creating event network-vif-plugged:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:18:42.155562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-3112e25c-b114-4ee6-8780-8c9b99ad121a req-963293c7-f3b2-4e3a-a3d8-c34a0f1faa87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035183 Oct 06 08:18:42.156195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 346/677] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:18:42.695915 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:42.696719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:42.703551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:42.704045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:42.705148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.705842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:42.706381 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:42.706804 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:42.846165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:42.855462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:42.856496 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:42.857774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5f214914-7359-4ef4-ada7-ad1742c37f7d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.166067 Oct 06 08:18:42.858405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 347/678] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:42 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:18:43.276245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-14593aa1-b107-4ddf-a35a-ec45d462637e tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "POST /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157495 Oct 06 08:18:43.276859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 332/679] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:18:42 2022] POST /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f/os-volume_attachments => generated 194 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:18:43.883236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:43.884097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:43.890712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:43.891232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:43.891675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:43.893579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:43.894042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:43.894465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:44.026443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:44.034994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:44.036430 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:44.037583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1e79e7c5-53f7-474c-96b8-68ccb0364998 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.158274 Oct 06 08:18:44.038141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 348/680] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:43 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:45.064329 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:45.065048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:45.071215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:45.071689 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:45.072121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:45.072797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:45.073242 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:45.073658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:45.206775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:45.215492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:45.216943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:45.218097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-92832269-3c33-4ce2-835c-cce53cb05555 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.158849 Oct 06 08:18:45.218662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 333/681] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:45 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:46.243489 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:46.244106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:46.250520 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:46.251089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:46.251532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:46.252413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:46.252866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:46.253293 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:46.383895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:46.394147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:46.395744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:46.396878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-78b2bb2f-0898-4641-87dd-5f6984e9b4e9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.157206 Oct 06 08:18:46.397658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 349/682] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:46 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:47.423676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:47.424403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:47.431151 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:47.431339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:47.431739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:47.432423 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:47.432870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:47.433286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:47.564683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:47.573283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:47.574707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:47.575887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f7f76a14-02fa-4193-92c3-4d28b46143ca tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1808 microversion: 2.20 time: 0.156988 Oct 06 08:18:47.576429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 334/683] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:47 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:18:48.601095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:18:48.601737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:18:48.608276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:48.608770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:48.609206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:48.609897 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:18:48.610357 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:18:48.610827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:18:48.748395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:48.750642 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:18:48.758461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:48.760199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:18:48.761350 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cbd6ed19-747d-4712-b50a-c81709a0e4e3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1795 microversion: 2.20 time: 0.164176 Oct 06 08:18:48.761907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 350/684] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:18:48 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:19:09.554717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:09.555266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:09.557897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=45 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:09.558586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:09.563832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:09.564312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:09.564747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:09.565436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:09.565886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:09.566309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:09.689105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lazy-loading 'services' on Instance uuid 2b82770a-b5c6-4ab1-bac0-69738bb6498f {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:19:09.889701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a714ad13-e73d-4e91-b140-13c5d35b7ec5 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f/os-volume_attachments/1afdb03b-2d4a-418b-b60e-707bf2182c60" status: 202 len: 0 microversion: 2.1 time: 0.339799 Oct 06 08:19:09.890321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 335/685] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:19:09 2022] DELETE /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f/os-volume_attachments/1afdb03b-2d4a-418b-b60e-707bf2182c60 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:19:12.067778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:12.068284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:12.070716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=35 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:12.075791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.076271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.076690 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.077362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.077808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.078224 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.102382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:19:12.161151 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:12.163791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:12.169883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.171591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.171591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.171591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.171878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.172284 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.403834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-85c4e2db-245b-40ac-8ff4-85640929a600 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 204 len: 0 microversion: 2.1 time: 0.340261 Oct 06 08:19:12.404541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 351/686] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:19:12 2022] DELETE /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:19:12.413699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:12.416228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:12.419270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-da6e18c8-8a2d-4eda-907a-3850a4662ba2 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action" status: 202 len: 0 microversion: 2.1 time: 0.263196 Oct 06 08:19:12.422875 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 336/687] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:19:12 2022] POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:19:12.423084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.423084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.423084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.423084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.423444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.423832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.428989 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:12.429691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:12.435944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.436429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.436870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.437566 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:12.438023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:12.438450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:12.555723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:12.565111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1f75a626-1e90-446a-988a-1c552301570d tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1513 microversion: 2.1 time: 0.155912 Oct 06 08:19:12.565705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 352/688] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:12 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:12.585844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:12.594136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cc6cfe75-4f0c-4e39-9b5a-7c58efc63745 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1753 microversion: 2.1 time: 0.169950 Oct 06 08:19:12.594702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 337/689] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:12 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:13.588206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:13.588814 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:13.595420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:13.595904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:13.596339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:13.597030 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:13.597485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:13.597907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:13.618600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:13.619229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:13.625554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:13.626034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:13.626463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:13.627168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:13.627611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:13.628027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:13.729205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:13.736776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ca88d98c-66fd-4ff7-993c-9ab7b99b0eeb tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1513 microversion: 2.1 time: 0.152526 Oct 06 08:19:13.737349 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 353/690] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:13 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:13.768893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:13.777555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-48987e58-a3bd-489f-b6fb-a41d14895841 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1753 microversion: 2.1 time: 0.163000 Oct 06 08:19:13.778115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 338/691] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:13 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:14.763479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:14.764145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:14.772379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:14.772857 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:14.773290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:14.774037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:14.774515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:14.774981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:14.800245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:14.800874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:14.806898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:14.807400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:14.807824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:14.808503 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:14.808947 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:14.809361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:14.954628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:14.964321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2aed1008-ae61-491f-a2f0-293bedc47193 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1753 microversion: 2.1 time: 0.167733 Oct 06 08:19:14.965101 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 339/692] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:14 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:15.304440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:15.312480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cdc0f283-f99f-46f8-b484-6f5716b93849 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1513 microversion: 2.1 time: 0.553132 Oct 06 08:19:15.313057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 354/693] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:14 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1513 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:15.802127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b82770a-b5c6-4ab1-bac0-69738bb6498f", "name": "network-vif-deleted", "tag": "2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:15.812592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:15.813061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:15.814657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:15.825390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] Creating event network-vif-deleted:2ccaea84-2bfa-4cb9-8684-e9d96a6c59fb for instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f on hv-cinder-86021 Oct 06 08:19:15.830198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-cd90605d-5210-4819-bac7-3aacf49a635e req-12b1ee5f-5c02-4052-ab25-8e60d4946a59 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085800 Oct 06 08:19:15.831002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 340/694] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:19:15.988728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:15.989320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:15.996236 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:15.996721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:15.997154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:15.997842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:15.998294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:15.998717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:16.148230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:16.159018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-59ba8afa-a413-4575-ab7b-18058fddbc9e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.174146 Oct 06 08:19:16.159609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 355/695] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:15 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:16.336517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:16.337131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:16.344012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:16.344549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:16.344986 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:16.345679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:16.346135 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:16.346563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:16.382220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:16.382702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:16.383171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:16.383594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lazy-loading 'fault' on Instance uuid 2b82770a-b5c6-4ab1-bac0-69738bb6498f {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:19:16.431380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fff5a88cba04475c9a0142156a2269f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '141863eb21404f229b8d624af2ff6743', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:16.444587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2132df72-04b0-4a26-9e4d-b5b84228f652 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 200 len: 1308 microversion: 2.1 time: 0.106996 Oct 06 08:19:16.444587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 341/696] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:16 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:17.183040 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:17.183655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:17.190084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:17.190564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:17.191023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:17.191710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:17.192161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:17.193336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:17.331056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:17.339228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-087d3619-fe39-4e2d-92cd-943ea4978e65 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.160047 Oct 06 08:19:17.339804 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 356/697] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:17 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:17.462274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:17.462794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] [instance: 2b82770a-b5c6-4ab1-bac0-69738bb6498f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:17.469442 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:17.469920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:17.470349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:17.471155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:17.471605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:17.472020 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:17.485867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] HTTP exception thrown: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Request method failure captured: Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f HTTP/1.1 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo6_lmQcmToVlfg5w7on-34S7sqv5J87O37BrVvT8dqkvn86J0IpvP9To1U970IS9d9xHj7y-nKeKk2UU53CJE6_DMe7TlzVpziNDMKCEQJEHLfp0I8PZDGRpLQbzQfD3oYKaAMzEEXi16Bf4U8RguZCyV0irDMxYy6sqTFw6PJmzjI Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 141863eb21404f229b8d624af2ff6743 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:19:17.487492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_141863eb21404f229b8d624af2ff6743"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/141863eb21404f229b8d624af2ff6743"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/141863eb21404f229b8d624af2ff6743"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/141863eb21404f229b8d624af2ff6743"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 141863eb21404f229b8d624af2ff6743 Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1171407741 Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesSnapshotTestJSON-1171407741-project Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: fff5a88cba04475c9a0142156a2269f0 Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesSnapshotTestJSON-1171407741-project Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. Oct 06 08:19:17.489028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '2b82770a-b5c6-4ab1-bac0-69738bb6498f'} Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:19:17.490455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. Oct 06 08:19:17.491994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:17.493282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] Returning 404 to user: Instance 2b82770a-b5c6-4ab1-bac0-69738bb6498f could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:19:17.493282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-92675051-7696-4015-9452-aee35a496809 tempest-VolumesSnapshotTestJSON-1171407741 tempest-VolumesSnapshotTestJSON-1171407741-project] 10.222.0.30 "GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f" status: 404 len: 111 microversion: 2.1 time: 0.030616 Oct 06 08:19:17.493282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 342/698] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:17 2022] GET /compute/v2.1/servers/2b82770a-b5c6-4ab1-bac0-69738bb6498f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:19:18.362348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:18.362882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:18.369670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:18.370154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:18.370688 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:18.371422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:18.371880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:18.372388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:18.513019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:18.521174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-eed2337a-d68a-4bf9-bf33-f45639962f1a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.162765 Oct 06 08:19:18.521746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 357/699] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:18 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:19.545234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:19.545883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:19.552260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:19.555732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:19.555732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:19.555732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:19.555732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:19.556129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:19.699278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:19.707476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-409098a2-7fa1-4027-a813-a5c4f3b50319 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.166094 Oct 06 08:19:19.708041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 343/700] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:19 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:20.731121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:20.731654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:20.738177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:20.738662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:20.739149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:20.739845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:20.740301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:20.740721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:20.881308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:20.890323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d8db2ee5-ca16-4ea3-90bf-f94c438204bb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.163183 Oct 06 08:19:20.890902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 358/701] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:20 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:21.913373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:21.914716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:21.921262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:21.921737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:21.922160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:21.922837 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:21.923301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:21.923715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:22.065731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:22.074006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-13f0d6bf-d14a-466a-bd47-d7b18a9579fb tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.164453 Oct 06 08:19:22.074572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 344/702] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:21 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:23.096698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:23.097361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:23.104783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:23.105261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:23.105693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:23.106373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:23.106817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:23.107270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:23.253397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:23.261958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-99beb925-7dec-4e05-bdc1-db6aa73f5b2a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.169140 Oct 06 08:19:23.262528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 359/703] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:23 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:24.285053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:24.285662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:24.292561 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:24.293043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:24.293475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:24.294152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:24.294601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:24.295043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:24.434459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:24.442639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f3352775-800e-41b7-a45f-e926417cbfe4 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.161388 Oct 06 08:19:24.443229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 345/704] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:24 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:25.466679 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:25.467348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:25.473456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:25.473931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:25.474360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:25.475078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:25.475527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:25.475952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:25.617785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:25.626078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b0983cbd-0e3c-4e37-bcea-4c018511a8ed tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.163465 Oct 06 08:19:25.626648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 360/705] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:25 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:26.650533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:26.651233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:26.657650 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:26.658131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:26.658568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:26.659290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:26.659738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:26.660165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:26.805168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:26.814020 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b9a0343f-7c9a-4dfa-a398-4840e0210520 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.168155 Oct 06 08:19:26.814587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 346/706] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:26 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:27.042681 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "450efac6-a84a-491d-be4d-4febdcd22c52"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:27.047431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:27.051333 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:27.051816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:27.052261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:27.053021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:27.053475 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:27.053893 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:27.773881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b0e4f8e5-d061-4583-899b-1b2024567d6d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839446 Oct 06 08:19:27.774566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 361/707] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:19:26 2022] POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:19:27.837490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:27.838097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:27.844549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:27.845029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:27.845462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:27.846141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:27.846592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:27.847041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:28.207178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:28.218411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2045995c-c8ac-4e26-ac48-344792427cf1 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.384492 Oct 06 08:19:28.219034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 347/708] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:27 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:29.245580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:29.246328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:29.252449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:29.252934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:29.253370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:29.254058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:29.254517 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:29.254967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:29.396963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:29.405699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-468760f5-3e81-4ef8-aa4c-205cb10a722a tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1758 microversion: 2.1 time: 0.165498 Oct 06 08:19:29.406281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 362/709] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:29 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:30.429603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:30.430121 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:30.437296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:30.437781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:30.438218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:30.438908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:30.439382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:30.442347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:30.589103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:30.597587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c0a6309d-5eec-4454-b075-9e63a266e826 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1761 microversion: 2.1 time: 0.171856 Oct 06 08:19:30.598243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 348/710] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:30 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:38.544486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:38.547473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:38.554567 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:38.555082 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:38.555578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:38.556267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:38.556772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:38.557192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:38.588538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'flavor' on Instance uuid 77274032-7602-49f0-8811-7ba4a0b369a4 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:19:38.688861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:38.945894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5fb614ae-1bee-490b-b93d-157e6da180e4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/action" status: 200 len: 32 microversion: 2.1 time: 0.405882 Oct 06 08:19:38.946749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 363/711] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:19:38 2022] POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/action => generated 32 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:19:38.957319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:38.957921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:38.964988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:38.965795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:38.966018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:38.966812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:38.967312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:38.967738 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:39.125780 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:39.135298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9e5eb11c-7a24-4aed-8d1b-09b7a4f0b26c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.181820 Oct 06 08:19:39.138322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 349/712] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:38 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:39.425033 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:39.425640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:39.432081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:39.432668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:39.433719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:39.434421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:39.434871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:39.435321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:39.519019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lazy-loading 'services' on Instance uuid a957af7c-67a0-48fd-9982-e38551889d44 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:19:39.671998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5fe3864e-5c47-4b42-812e-ae092a4fb014 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments/027c5f57-531a-4e02-b6c4-5f405c734d8f" status: 202 len: 0 microversion: 2.1 time: 0.357341 Oct 06 08:19:39.673987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 364/713] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:19:39 2022] DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments/027c5f57-531a-4e02-b6c4-5f405c734d8f => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:19:40.165323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:40.167792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:40.168428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=33 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:40.173219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:40.173706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:40.174141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:40.174833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:40.175324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:40.175752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:40.178391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:40.302993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:40.311602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-34bb7fb6-91a9-4312-90d1-b0754332d5f0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.150171 Oct 06 08:19:40.312170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 350/714] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:40 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:41.336652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:41.337273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:41.344347 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:41.344824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:41.345254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:41.345932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:41.346379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:41.346798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:41.478744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:41.487970 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae582f0c-3030-4f36-9820-2165a11cdd78 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.156042 Oct 06 08:19:41.488536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 365/715] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:41 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:41.862964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:41.870085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:41.870571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:41.871023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:41.893699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Going to try to stop instance {{(pid=121076) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 06 08:19:42.046711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-86e9e93e-c2e8-4138-9b98-04f5f3fb1ad6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action" status: 202 len: 0 microversion: 2.1 time: 0.187424 Oct 06 08:19:42.047363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 351/716] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:19:41 2022] POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:19:42.055447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:42.056154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:42.063406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:42.067847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:42.067847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:42.067847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:42.067847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:42.068231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:42.210200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:42.218983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-26ec1ef0-397d-44fe-9b31-f68f3da22eb0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.167328 Oct 06 08:19:42.219728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 366/717] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:42 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:42.511809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:42.512563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:42.518685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:42.519201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:42.519641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:42.520316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:42.520783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:42.521182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:42.655832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:42.669139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-167f768a-a199-4a10-8c06-6ddf89dbf936 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.160971 Oct 06 08:19:42.669139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 352/718] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:42 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:43.241580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:43.242210 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:43.244662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:43.250057 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:43.250539 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:43.251005 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:43.251694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:43.252150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:43.252580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:43.384614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:43.393122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-431f7df6-dd7e-45a0-be02-5136885a120e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.155411 Oct 06 08:19:43.393695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 367/719] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:43 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:43.691719 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:43.692319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:43.698664 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:43.699194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:43.699633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:43.700424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:43.700874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:43.701297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:43.827869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:43.835971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f611d2a6-22b7-41b7-a257-14fced2b30d4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.148277 Oct 06 08:19:43.836533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 353/720] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:43 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:44.416146 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:44.416753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:44.423315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:44.423798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:44.424237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:44.424924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:44.425379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:44.425807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:44.552563 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:44.560148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-463cb5f5-0e65-4db9-841e-97b7165439e1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.147919 Oct 06 08:19:44.561310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 368/721] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:44 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:44.858882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:44.860083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:44.866308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:44.866786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:44.867249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:44.867924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:44.868368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:44.868785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:45.004790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:45.013765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d86d3745-275c-489a-827a-a72da6473b11 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.158677 Oct 06 08:19:45.014342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 354/722] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:44 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:45.583120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:45.583895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:45.590463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:45.590966 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:45.591414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:45.592105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:45.592562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:45.593010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:45.728915 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:45.737142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-230775ba-41a8-4bb9-ba12-80ec4a41fb9b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.157951 Oct 06 08:19:45.737713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 369/723] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:45 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:46.038627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:46.039252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:46.045072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:46.045543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:46.045972 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:46.046644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:46.047138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:46.047551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:46.178611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:46.193162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7c748171-8a41-4b87-829f-0672d3a3b1c6 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.158393 Oct 06 08:19:46.193680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 355/724] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:46 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:46.760254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:46.760888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:46.767692 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:46.768175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:46.768609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:46.769300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:46.769751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:46.770173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:46.910722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:46.918413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-080ff8aa-5178-4a25-a73e-031b678a2b1a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.162200 Oct 06 08:19:46.918994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 370/725] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:46 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:47.217465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:47.218103 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:47.225063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:47.225548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:47.225992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:47.226675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:47.227163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:47.227588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:47.357074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:47.367224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6ee2af67-dac6-43f1-98ea-4fcd39a0b495 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.153520 Oct 06 08:19:47.367805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 356/726] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:47 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:47.942462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:47.943176 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:47.949653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:47.950229 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:47.950667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:47.951381 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:47.951839 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:47.952259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:48.121414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:48.129964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-05a5f513-09fd-481f-925c-8bf2d6f9a59d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.192061 Oct 06 08:19:48.130916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 371/727] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:47 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:48.389729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:48.390330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:48.396814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:48.397293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:48.397730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:48.399807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:48.399807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:48.399807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:48.529245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:48.537664 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1577081a-9897-4984-bb57-9092d4f7bf4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.151753 Oct 06 08:19:48.538258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 357/728] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:48 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:49.158756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:49.159522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:49.166546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:49.167196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:49.167715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:49.168420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:49.168875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:49.169296 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:49.330492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:49.338097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a4db3172-80ba-4e2e-8e32-7601bce4852f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.184578 Oct 06 08:19:49.338694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 372/729] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:49 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:49.561679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:49.562196 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:49.569003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:49.569485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:49.569921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:49.570599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:49.571079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:49.571503 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:49.697084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:49.705687 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f27d387a-0b33-4a59-a084-f45c9e555c0c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.147945 Oct 06 08:19:49.706252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 358/730] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:49 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:50.360541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:50.361173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:50.367760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:50.368250 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:50.368683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:50.369372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:50.369827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:50.370252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:50.496603 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:50.504928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e972f14f-a908-4fae-8101-528f39b3e164 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.148336 Oct 06 08:19:50.505538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 373/731] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:50 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:50.729618 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:50.730127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:50.737147 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:50.737630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:50.738063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:50.738736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:50.739203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:50.739619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:50.868917 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:50.878249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-47858907-d814-4cf2-824b-97495bf8a8d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.152516 Oct 06 08:19:50.878811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 359/732] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:50 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:51.528247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:51.528864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:51.536092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:51.536579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:51.537021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:51.537707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:51.538162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:51.538587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:51.664289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:51.672062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7fd67f8a-8c03-4919-b817-4afd66430827 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.147779 Oct 06 08:19:51.672630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 374/733] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:51 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:51.902314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:51.902862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:51.909881 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:51.910371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:51.910809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:51.911541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:51.912030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:51.912491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:52.041740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:52.050859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b02b5b38-a5fb-4516-9888-40985ca6c900 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.153224 Oct 06 08:19:52.051479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 360/734] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:51 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:52.695200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:52.695845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:52.702186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:52.702668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:52.703141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:52.703835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:52.704291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:52.705289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:52.834767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:52.842453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ea597604-2560-495f-9333-16adee0f5e59 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.151140 Oct 06 08:19:52.843041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 375/735] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:52 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:53.076460 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:53.079355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.083985 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.084469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.084907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.085593 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.086047 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.086470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.086904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:53.087475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.093532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.094096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.094594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.096035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.096556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.097052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.120453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0bb431bb-1a14-47b6-b4f3-aca0fdef7dcc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/ips" status: 200 len: 149 microversion: 2.1 time: 0.253721 Oct 06 08:19:53.121110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 361/736] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:19:52 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/ips => generated 149 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:19:53.133413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:53.136233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.144789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.144789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.144789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.144789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.145172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.145415 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.224353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:53.226467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: POST /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/os-volume_attachments HTTP/1.1 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 74 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:19:53.228263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {"volumeAttachment": {"volumeId": "efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e"}} Oct 06 08:19:53.229707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'server_id': '2eb0dfcf-fa42-40d8-b33c-b143432d90ad', 'body': {'volumeAttachment': {'volumeId': 'efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e'}}} Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:53.230468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:53.231710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 400 to user: Invalid volume: volume efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e is already attached to instances: f517d63c-e311-4c11-98b1-48e50f55b6fe {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-583b6a58-af80-4c80-84f7-6141aabff657 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100280 Oct 06 08:19:53.233142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 362/737] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:19:53 2022] POST /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 06 08:19:53.234249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-308e94c3-b7e1-470e-a6f6-7d6a70815822 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1734 microversion: 2.1 time: 0.161548 Oct 06 08:19:53.234824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 376/738] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:53 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:53.238700 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:53.239282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.247633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.248124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.248560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.249245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.249700 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.250152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.275268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:19:53.500638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-79e37963-49d0-4676-8232-736e791842c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 204 len: 0 microversion: 2.1 time: 0.265439 Oct 06 08:19:53.501272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 363/739] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:19:53 2022] DELETE /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:19:53.510220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:53.510825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.516705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.519276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.519276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.519276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.519276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.519646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.648969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:53.656755 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-65e9f50f-e1c0-426a-897d-00c9611c94d5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1681 microversion: 2.1 time: 0.150576 Oct 06 08:19:53.657346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 377/740] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:53 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:53.866271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:53.866877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:53.872993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.873469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.873896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.874596 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:53.875195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:53.875626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:53.890697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:54.008784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:54.016692 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7dc47185-2deb-48e3-bc52-f3379311e9ae tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.154798 Oct 06 08:19:54.017260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 364/741] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:53 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:54.258451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:54.259079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:54.265647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.266119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.266546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.267257 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.267702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.268747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.283294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:19:54.401439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:54.411546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-62e44885-542d-4255-8686-aa65f24059c2 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1714 microversion: 2.1 time: 0.156934 Oct 06 08:19:54.414588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 378/742] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:54 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:54.520875 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:54.521374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:54.527591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.528113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.528576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.529268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.529720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.530144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.608432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] HTTP exception thrown: Cannot 'detach_volume' instance 77274032-7602-49f0-8811-7ba4a0b369a4 while it is in vm_state rescued Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Request method failure captured: Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments/450efac6-a84a-491d-be4d-4febdcd22c52 HTTP/1.1 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44j6z1K7FntfimuG7BkJKrChOjKGGCi5vuzxL-ui6Bp-YO32gSJx4zy2G39zbq51zSDmHHFfcfrB03Iy_d74SNl-XapWbJ52_BbNogPBAS8audB8QW9qei9izScHPCOpnZFm0XPfi6jMi6024YJFt72cKBONXVQcdR9Hvx2yjMP3w Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:19:54.610033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 85bdfc4b6ad443d68ebc0d6932ccad66 Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:19:54.611582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Cannot 'detach_volume' instance 77274032-7602-49f0-8811-7ba4a0b369a4 while it is in vm_state rescued Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'server_id': '77274032-7602-49f0-8811-7ba4a0b369a4', 'id': '450efac6-a84a-491d-be4d-4febdcd22c52'} Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:19:54.612482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 77274032-7602-49f0-8811-7ba4a0b369a4 while it is in vm_state rescued Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 77274032-7602-49f0-8811-7ba4a0b369a4 while it is in vm_state rescued Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:19:54.613934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Returning 409 to user: Cannot 'detach_volume' instance 77274032-7602-49f0-8811-7ba4a0b369a4 while it is in vm_state rescued {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:19:54.615127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0e5a6f1b-5f4b-46ca-900c-3f4a7acd76f4 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments/450efac6-a84a-491d-be4d-4febdcd22c52" status: 409 len: 152 microversion: 2.1 time: 0.095173 Oct 06 08:19:54.615127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 365/743] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:19:54 2022] DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments/450efac6-a84a-491d-be4d-4febdcd22c52 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 06 08:19:54.620440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:54.620974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:54.628051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.628540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.628977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.629656 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.630110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.630532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.717789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:54.718340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:54.725195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.725670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.726099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.726777 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.727251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.727668 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.808418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e1a9cb1a-86c6-4719-a474-b5ad4e40422c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/action" status: 202 len: 0 microversion: 2.1 time: 0.191426 Oct 06 08:19:54.812433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 379/744] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:19:54 2022] POST /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:19:54.819932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:54.820707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:54.827111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.827638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.828036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.828728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:54.829195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:54.829647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:54.863576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:54.871382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b2633254-7ebe-4604-91bc-c2ac6f4dfd74 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1681 microversion: 2.1 time: 0.157543 Oct 06 08:19:54.871953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 366/745] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:54 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:54.959297 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:54.967482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3964034d-8ef7-49e5-b3a8-b14e927eb9ea tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1722 microversion: 2.1 time: 0.153570 Oct 06 08:19:54.968105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 380/746] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:54 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:55.048504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:55.049783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:55.056301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:55.056788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:55.057224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:55.057939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:55.058405 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:55.058812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:55.187098 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:55.195676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a221acba-0147-4520-adbe-4f5a6d05f00f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.150869 Oct 06 08:19:55.204231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 367/747] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:55 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:55.898117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:55.898743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:55.905301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:55.905790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:55.906219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:55.906896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:55.907373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:55.907791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:55.991642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:55.992241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:55.998681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:55.999304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:55.999739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:56.000428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:56.000877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:56.001294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:56.037206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:56.045294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6a36d465-b9e6-4b83-98c9-6339f8be2941 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1681 microversion: 2.1 time: 0.151541 Oct 06 08:19:56.045905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 381/748] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:55 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:56.141736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:56.152319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-077a6f7d-4831-4212-8d65-22a5039ab98b tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1722 microversion: 2.1 time: 0.165184 Oct 06 08:19:56.154787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 368/749] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:55 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:56.218596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:56.219248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:56.225619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:56.226097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:56.226534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:56.227263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:56.227713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:56.228130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:56.520126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:56.528004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-25242fd4-794b-4394-8a50-395a4d3229a9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.313162 Oct 06 08:19:56.528613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 382/750] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:56 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:57.071406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:57.071979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:57.083956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.084455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.084897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.085614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.088075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.088516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.178352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:57.179590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:57.186158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.186640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.187273 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.187967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.188415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.189079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.226828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:57.234703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-97e75627-ef52-4291-adce-684183b295c7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1681 microversion: 2.1 time: 0.169485 Oct 06 08:19:57.235651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 369/751] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:57 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:57.441133 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:57.450305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3a324b13-8a28-470e-852d-0333d691b2d7 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1722 microversion: 2.1 time: 0.276487 Oct 06 08:19:57.450872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 383/752] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:57 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:19:57.554359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:57.555255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:57.561406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.561899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.562341 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.563066 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.563703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.564006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.700843 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:57.709893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-591f8ae8-a1f9-4bf0-81fe-4e47ede53fb8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1676 microversion: 2.1 time: 0.160983 Oct 06 08:19:57.710486 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 370/753] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:57 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:57.838253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eb0dfcf-fa42-40d8-b33c-b143432d90ad", "name": "network-vif-deleted", "tag": "bae8df64-50c3-4330-a9c1-a7d4846124b1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:57.848360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:57.848839 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:57.849267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:57.860773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] Creating event network-vif-deleted:bae8df64-50c3-4330-a9c1-a7d4846124b1 for instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad on hv-cinder-86021 Oct 06 08:19:57.866834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-3c78c758-8e2a-41ad-94dd-7e4037f786d2 req-adc8402b-d93d-495d-8d7a-1805cb4e65d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Oct 06 08:19:57.867481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 384/754] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:19:58.260698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:58.261709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:58.268942 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.269480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.270134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.270616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.271095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.271519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.334753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:58.345280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6e5c9e4e-4774-4dea-8ae5-c66e6adaf381 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1613 microversion: 2.1 time: 0.089372 Oct 06 08:19:58.350610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 371/755] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:58 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:58.475772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:58.476387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:58.482579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.483100 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.483532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.484220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.484667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.485128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.639123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:58.648672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e9ed5806-d01c-4570-9456-76e8014470aa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1722 microversion: 2.1 time: 0.178484 Oct 06 08:19:58.649253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 385/756] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:58 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:58.738271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:58.738968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:58.745250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.745906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.746385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.747130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.747603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.748022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.888398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:58.898527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-75ecb298-2c0e-42ed-b6be-523ea87cbf1d tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1653 microversion: 2.1 time: 0.167675 Oct 06 08:19:58.899743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 372/757] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:58 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1653 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:58.931952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:19:58.938240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:58.938719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:58.939181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:58.962321 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Going to try to start instance {{(pid=121077) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 06 08:19:59.157065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3fe49d7d-b45c-4cb1-9b83-ca6bb46c7c0c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action" status: 202 len: 0 microversion: 2.1 time: 0.229638 Oct 06 08:19:59.157903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 386/758] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:19:58 2022] POST /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:19:59.166431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:59.167100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:59.173314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.173803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.174236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.174914 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.175384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.176614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.310336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:59.318155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d38048eb-e9ec-4d3f-b530-844adcea3181 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1662 microversion: 2.1 time: 0.155712 Oct 06 08:19:59.318714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 373/759] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:59 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:59.370542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:59.371362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:59.377435 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.377912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.378336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.379421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.379572 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.379994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.443955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:59.451785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fa91f27f-f0e0-4c83-a129-8426f318c3ad tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1613 microversion: 2.1 time: 0.085892 Oct 06 08:19:59.452447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 387/760] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:59 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:19:59.673783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:19:59.674686 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:19:59.686532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.687099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.692537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.692537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:19:59.692537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:19:59.692537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:19:59.820450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:19:59.828628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e7389fe1-208d-4160-a22d-29bbe016c047 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1722 microversion: 2.1 time: 0.159238 Oct 06 08:19:59.829187 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 374/761] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:19:59 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:00.342868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:00.343501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:00.350254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.350741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.351218 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.351913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.352360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.352776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.475543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:00.476154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:00.482488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.482990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.483429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.484122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.484576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.484993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.489922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:00.497542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-454cf177-0805-494f-b0a8-e0824259a426 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1662 microversion: 2.1 time: 0.158544 Oct 06 08:20:00.498109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 388/762] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:00 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:00.523678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.524158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.524673 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.525480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid 2eb0dfcf-fa42-40d8-b33c-b143432d90ad {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:00.573750 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:00.578285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-19234f44-9e34-404d-a3cf-7bd85a4faf05 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 200 len: 1331 microversion: 2.1 time: 0.106567 Oct 06 08:20:00.578856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 375/763] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:00 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:20:00.852414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:00.853029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:00.859113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.859596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.860029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.860708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:00.861173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:00.861600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:00.987129 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:00.996005 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-33666e20-64d8-4bb2-a4a8-f9572236b294 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1728 microversion: 2.1 time: 0.147598 Oct 06 08:20:00.996580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 389/764] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:00 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:01.019058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:01.019577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:01.025641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.026067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.026527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.027429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.027882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.028301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.106964 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6abdbf5e-ddae-401c-bb61-6e1797860e21 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091682 Oct 06 08:20:01.108317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 376/765] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:20:01 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:01.523073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:01.524245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:01.530757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.531275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.531763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.532398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.532854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.533272 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.608043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:01.609273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:01.615488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.615979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.616416 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.617167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:01.617558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:01.617975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:01.632623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad HTTP/1.1 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:20:01.634279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:20:01.636172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '2eb0dfcf-fa42-40d8-b33c-b143432d90ad'} Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:20:01.636913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:20:01.638145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:01.639313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:20:01.639313 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-026d2bdd-6761-4b25-853e-0044805c861d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 404 len: 111 microversion: 2.1 time: 0.032332 Oct 06 08:20:01.639949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 377/766] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:01 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:20:01.645878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-609bcaa2-130e-4924-a754-180c0817cae3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '.version_select at 0x7f9237aa1820>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:01.687438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:01.696379 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-35284f0a-c0e5-45a0-b744-762b8dae70f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1662 microversion: 2.1 time: 0.177126 Oct 06 08:20:01.696946 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 390/767] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:01 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1662 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:01.794068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-609bcaa2-130e-4924-a754-180c0817cae3 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651056390" status: 202 len: 0 microversion: 2.1 time: 0.152793 Oct 06 08:20:01.794625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 378/768] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Oct 6 08:20:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651056390 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:20:02.268340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:02.279139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:02.279612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:02.280257 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:02.307064 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] Creating event network-changed:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:20:02.312834 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-c5cd7e2d-d0f4-49c7-bb35-f457fa3f32bf req-bb23e1a1-6aff-42d4-9983-37f88cbab63c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184114 Oct 06 08:20:02.315579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 391/769] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:02.721592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:02.722195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:02.731238 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:02.732051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:02.732488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:02.733186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:02.733632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:02.734234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:02.843483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:02.845411 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:02.854440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:02.855325 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:02.855936 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:02.857006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:02.857614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:02.858486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:02.910543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:02.919114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-666ee71e-464e-438c-839e-b6858ed58d03 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1666 microversion: 2.1 time: 0.201953 Oct 06 08:20:02.932072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 379/770] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:02 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1666 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:02.968939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'services' on Instance uuid f517d63c-e311-4c11-98b1-48e50f55b6fe {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:03.174221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b3e1f2df-d888-4746-94ab-0f5bddf99acc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments/efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e" status: 202 len: 0 microversion: 2.1 time: 0.338511 Oct 06 08:20:03.179094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 392/771] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:20:02 2022] DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments/efd5cbb3-c1b9-4a2d-b812-3eea2a2e4b3e => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:20:03.183575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:03.186070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:03.193438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:03.193926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:03.194361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:03.195231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:03.199378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:03.199378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:03.226638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a54fc3cc-6966-4f35-b397-db70fac71232 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047201 Oct 06 08:20:03.227223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 380/772] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:03 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:04.240515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:04.242799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:04.248917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:04.249402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:04.249835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:04.250523 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:04.251008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:04.251441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:04.276527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:04.281276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-16edb7dc-6fd2-45b6-8f17-9198514ae25b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Oct 06 08:20:04.281838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 393/773] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:04 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:04.329624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:04.340095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:04.340599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:04.341061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:04.352189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] Creating event network-changed:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:20:04.357427 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-366b0da5-a143-4909-8d3f-7ad9a61963ab req-d24c8d5c-4a84-493d-bdde-eca689ee5f2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031502 Oct 06 08:20:04.357991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 381/774] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:05.293772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:05.295957 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:05.303726 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.304206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.304641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.305328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.305778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.306202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.334134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-48caaf29-9878-47d4-8ac4-e1c11ba8f0de tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044349 Oct 06 08:20:05.334687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 394/775] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:05 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:20:05.398393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:05.398991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:05.405234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.405641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.406072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.406757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.407260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.407679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.432951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:20:05.455449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:05.723939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9a00b3ad-a9ac-4727-9775-6a51308dc84a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 204 len: 0 microversion: 2.1 time: 0.329926 Oct 06 08:20:05.724453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 382/776] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:20:05 2022] DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:20:05.733193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:05.733786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:05.740026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.740502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.740937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.741620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:05.742071 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:05.742507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:05.881698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:05.889816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1c5d6b05-42cc-4e0d-8529-d2b19a5ec491 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1683 microversion: 2.1 time: 0.160811 Oct 06 08:20:05.890387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 395/777] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:05 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:06.914353 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:06.915081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:06.921488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:06.921970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:06.922412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:06.923140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:06.923745 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:06.924283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:07.063150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:07.071689 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-87581b01-ba1f-4871-bd81-1724bcd99fc0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1683 microversion: 2.1 time: 0.161725 Oct 06 08:20:07.072515 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 383/778] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:06 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:07.709602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f517d63c-e311-4c11-98b1-48e50f55b6fe", "name": "network-vif-deleted", "tag": "d560f3d8-ea78-4a57-a945-9188174f94fc"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:07.719640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:07.722183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:07.722183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:07.731972 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] Creating event network-vif-deleted:d560f3d8-ea78-4a57-a945-9188174f94fc for instance f517d63c-e311-4c11-98b1-48e50f55b6fe on hv-cinder-86021 Oct 06 08:20:07.736971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-950c27ae-98bb-4e90-adae-8bc422442108 req-553d8a68-498e-43bf-bd7e-fe5c70e7d2d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031996 Oct 06 08:20:07.737504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 396/779] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:08.095921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:08.096439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:08.103003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.103492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.103930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.104626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.105067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.105488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.139199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.139672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.140285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.140722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid f517d63c-e311-4c11-98b1-48e50f55b6fe {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:08.187323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:08.191821 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2f598c40-15ce-4c99-8296-a825de8d9a70 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 200 len: 1331 microversion: 2.1 time: 0.099321 Oct 06 08:20:08.192397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 384/780] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:08 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:08.398207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:08.398793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:08.405317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.410189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.410189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.410189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.410189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.410573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.437923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fcbfd527-5d72-43e3-92f7-bc1128c8da65 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments/6f708138-af08-468b-b82f-373e32a7e9a8" status: 200 len: 194 microversion: 2.20 time: 0.044673 Oct 06 08:20:08.438449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 397/781] 10.222.0.30 () {60 vars in 1454 bytes} [Thu Oct 6 08:20:08 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments/6f708138-af08-468b-b82f-373e32a7e9a8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:20:08.512365 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:08.512882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:08.519011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.519513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.519954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.520657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.521144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.521578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.606094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lazy-loading 'services' on Instance uuid aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:08.838647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a8514fd3-69d0-4ba7-b5a5-ce8c94ee1232 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments/6f708138-af08-468b-b82f-373e32a7e9a8" status: 202 len: 0 microversion: 2.20 time: 0.330281 Oct 06 08:20:08.839277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 385/782] 10.222.0.30 () {60 vars in 1457 bytes} [Thu Oct 6 08:20:08 2022] DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments/6f708138-af08-468b-b82f-373e32a7e9a8 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:20:08.848719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:08.855347 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:08.861802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.862296 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.862810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.864921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:08.864921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:08.865130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:08.896542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8cf34fb5-9030-41e2-95c8-d65f3f4e9212 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052674 Oct 06 08:20:08.897122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 398/783] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Oct 6 08:20:08 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:20:09.217229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:09.217967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:09.225281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:09.225763 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:09.226200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:09.226884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:09.227368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:09.227790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:09.243094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe HTTP/1.1 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:20:09.244704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:20:09.246245 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'f517d63c-e311-4c11-98b1-48e50f55b6fe'} Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:20:09.247184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:20:09.248410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:09.249457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:20:09.249457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-12f2a2eb-f771-487e-96e4-70e7e374bbe7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 404 len: 111 microversion: 2.1 time: 0.033202 Oct 06 08:20:09.249457 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 386/784] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:09 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:20:09.256033 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-69a5c3e2-a43c-4afd-b5d9-70f75b94a8bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '.version_select at 0x7f923f396d30>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:09.359014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-69a5c3e2-a43c-4afd-b5d9-70f75b94a8bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327080643" status: 202 len: 0 microversion: 2.1 time: 0.107637 Oct 06 08:20:09.359553 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 399/785] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Oct 6 08:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327080643 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:20:09.909723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:09.911961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:09.918006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:09.921397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:09.921397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:09.921397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:09.921397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:09.921814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:10.102184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2e566b69-f15d-4221-b52f-765f09ff667c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196546 Oct 06 08:20:10.102744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 387/786] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Oct 6 08:20:09 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:20:10.163486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a1283153-0e4e-4435-8890-8974c8fd7518 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: .version_select at 0x7f923f31ea60>, body: {"keypair": {"name": "tempest-keypair-1409564153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4RFLXfLY1YORyWjZPtH49V77AXv3ACEhTNpwIkulKmxegiBzE6AywY0ZPDvtaPS9xSWJx5qPZlRqh8GKLjK1YZt/h8YQlbiYd9EWpkPLAUpkyY/l4jUzQRi7QLGAG57g=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:10.181602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-a1283153-0e4e-4435-8890-8974c8fd7518 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:20:10.185348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-a1283153-0e4e-4435-8890-8974c8fd7518 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:20:10.336178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a1283153-0e4e-4435-8890-8974c8fd7518 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.176740 Oct 06 08:20:10.336806 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 400/787] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:20:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:11.115029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:11.117348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:11.119940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:11.124688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.125167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.125608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.126540 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.127035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.127453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.162543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-db2d28dd-a295-41e5-8443-97fc935ca1a5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051913 Oct 06 08:20:11.163270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 388/788] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Oct 6 08:20:11 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:11.231124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:11.231606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:11.237441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.237931 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.238360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.239504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.239629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.239978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.266859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:20:11.597905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-60f07eae-c913-40f6-8ff5-9b242c0c44bb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 204 len: 0 microversion: 2.20 time: 0.370915 Oct 06 08:20:11.598507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 401/789] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Oct 6 08:20:11 2022] DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 08:20:11.606779 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:11.607967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:11.614567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.615075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.615510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.616196 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:11.616644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:11.617061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:11.755011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:11.763586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:11.765039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:11.766195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8c733621-d445-44d4-8b5b-fc931ca49878 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.163307 Oct 06 08:20:11.766781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 389/790] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:11 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:12.722832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-474067020", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916cf03d-8c1b-4b3b-a1cf-702059cc42e1"}], "security_groups": [{"name": "tempest-securitygroup--2001880304"}], "key_name": "tempest-keypair-1409564153", "user_data": "}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:12.793674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:12.794274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:12.801395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:12.801880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:12.802310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:12.803028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:12.803475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:12.803893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:12.828747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] validate_networks() for [('916cf03d-8c1b-4b3b-a1cf-702059cc42e1', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:20:12.949100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:12.958529 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:12.960011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:12.961182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-301dda37-5b53-4130-9ce5-f755f801b449 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.171533 Oct 06 08:20:12.962533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 390/791] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:12 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:13.335578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:20:13.335578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:20:13.335578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:20:13.335578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:20:13.335578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:20:13.336080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:13.336080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:13.336080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:13.336080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:13.336401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:13.336401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:13.353606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:20:13.355788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:13.358148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:20:13.369393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:20:13.371777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:20:13.518015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [fd2d864c-7db1-47b3-8261-6971099a1295] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 08:20:13.986726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:13.987476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:13.994090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:13.994577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:13.995048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:13.995752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:13.996207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:13.996630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:14.131096 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:14.140422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:14.144466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:14.144466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7cd917f4-5e36-4fc3-bfa3-79fd7c983dc0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1723 microversion: 2.20 time: 0.160240 Oct 06 08:20:14.144466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 391/792] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:13 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:14.525858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO oslo.messaging._drivers.impl_rabbit [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [fd2d864c-7db1-47b3-8261-6971099a1295] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 34390. Oct 06 08:20:14.531282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2584a6e3-80f3-4f9f-b0a9-4df9da12d205 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.813640 Oct 06 08:20:14.539056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 402/793] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:20:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:20:14.544177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fbaf326e-7542-42f9-9938-d98adae9c358 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:14.544862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fbaf326e-7542-42f9-9938-d98adae9c358 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:14.582821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a", "name": "network-vif-deleted", "tag": "efac89f9-62bc-419f-9213-b2e40d36e138"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:14.598497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:14.599121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:14.599560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:14.613955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] Creating event network-vif-deleted:efac89f9-62bc-419f-9213-b2e40d36e138 for instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a on hv-cinder-86021 Oct 06 08:20:14.623340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-d84954e2-1aba-4519-8bee-9e093d793eaa req-2fa6fcc1-dc23-4e3d-89fb-b62902e6b61f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041305 Oct 06 08:20:14.630993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 403/794] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:14.640541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fbaf326e-7542-42f9-9938-d98adae9c358 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:14.661403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fbaf326e-7542-42f9-9938-d98adae9c358 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1241 microversion: 2.1 time: 0.120745 Oct 06 08:20:14.664449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 392/795] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:14 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:15.171566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:15.172532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:15.179823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:15.180491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:15.185066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:15.185066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:15.185066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:15.185066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:15.222837 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:15.223480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:15.224099 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:15.224543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lazy-loading 'fault' on Instance uuid aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:15.266310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:15.275170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:15.276751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:15.277852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3d818035-c370-4909-86a3-447ed4cebd82 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 200 len: 1372 microversion: 2.20 time: 0.112087 Oct 06 08:20:15.278423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 404/796] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:15 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:15.692808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:15.693476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:15.700215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:15.700215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:15.701190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:15.702124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:15.702682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:15.703235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:15.772161 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:15.780295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a0d1439a-375e-403e-a8be-4fd202045ac7 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1245 microversion: 2.1 time: 0.092746 Oct 06 08:20:15.780848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 393/797] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:15 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:16.304601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:16.305204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:16.311605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:16.312094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:16.312527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:16.313230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:16.313676 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:16.314097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:16.328244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a HTTP/1.1 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:20:16.330001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:20:16.331674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a'} Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:20:16.333442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:20:16.334923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:16.336255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:20:16.336255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b854fc8b-2c9d-4967-b8d4-3eb6767a3bcd tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 404 len: 111 microversion: 2.20 time: 0.031121 Oct 06 08:20:16.336255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 405/798] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:16 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:20:16.340678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9af6d64f-1681-45a1-88b3-706b95d997e1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '.version_select at 0x7f9237b2ac10>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:16.433316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9af6d64f-1681-45a1-88b3-706b95d997e1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428677554" status: 204 len: 0 microversion: 2.20 time: 0.096348 Oct 06 08:20:16.433928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 394/799] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Oct 6 08:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428677554 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 08:20:16.803788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:16.804418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:16.810281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:16.810766 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:16.811239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:16.811934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:16.812384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:16.812808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:16.887732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:16.895905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-bab68104-b66c-4c56-ab1b-9a016cc5c691 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1293 microversion: 2.1 time: 0.096560 Oct 06 08:20:16.896477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 406/800] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:16 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:17.325751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-666972d0-9dc2-4d81-bfdd-684943f7624a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: .version_select at 0x7f9237b10160>, body: {"keypair": {"name": "tempest-keypair-1693713352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLo5lWh5dzbd15A1sL7vlIzuBQxYxTAOohWD7EY7zuGHkjV7QJ6JUAqqaIOnvYmVMyrtAxCdnOkzsNj9RP7CMhIeX74m11afjBrlxkDrEBA5B2v8iDMYbgbsylRrQURNg=="}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:17.344191 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-666972d0-9dc2-4d81-bfdd-684943f7624a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:20:17.348114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-666972d0-9dc2-4d81-bfdd-684943f7624a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for user 36b26040882a4e85b82b40a3c17d33bb and project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:20:17.433916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-666972d0-9dc2-4d81-bfdd-684943f7624a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112917 Oct 06 08:20:17.434448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 395/801] 10.222.0.30 () {62 vars in 1200 bytes} [Thu Oct 6 08:20:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 06 08:20:17.920783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:17.921400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:17.928159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:17.928650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:17.929093 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:17.929798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:17.930263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:17.930687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:18.002203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:18.012008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2274fd62-48c8-42d6-9ceb-0fee501cabb1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1299 microversion: 2.1 time: 0.094910 Oct 06 08:20:18.012747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 407/802] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:17 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:19.038192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf52209-2aa9-40ad-8cf5-76c38ac74b41", "tag": "9f9ef7e0-f04d-4b74-b05b-a57559617076"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:19.048073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:19.048502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:19.048989 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:19.048989 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:19.049855 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:19.058043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:19.058934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:19.059631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:19.060527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:19.061172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:19.061812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:19.062824 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] Creating event network-changed:9f9ef7e0-f04d-4b74-b05b-a57559617076 for instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 on hv-cinder-86021 Oct 06 08:20:19.068419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-19602ced-bd7e-4075-b0ef-36def961ee5b req-518407c6-88fc-4edb-b7d3-cc6289442929 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Oct 06 08:20:19.069191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 408/803] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:19.300608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:19.309687 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d00c0022-831e-4918-a9ee-ce5b97d5d177 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.276922 Oct 06 08:20:19.315292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 396/804] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:19 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:20.121165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1891270304", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "196136f6-8e40-440d-a011-583cca4d460b"}], "security_groups": [{"name": "tempest-securitygroup--462623344"}], "key_name": "tempest-keypair-1693713352", "user_data": "}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:20.226247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] validate_networks() for [('196136f6-8e40-440d-a011-583cca4d460b', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:20:20.334254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:20.334857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:20.341402 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:20.341885 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:20.342317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:20.343024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:20.343472 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:20.343893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:20.473586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:20.481344 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5491576e-3f75-4b4b-ba52-c9500bfe3478 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.151699 Oct 06 08:20:20.481992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 397/805] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:20 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:20:20.593150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:20:20.593577 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:20:20.594050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:20:20.594457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:20:20.594869 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:20:20.603767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:20.604247 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:20.604680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:20.605439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:20.605889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:20.606312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:20.624103 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:20:20.630038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Getting quotas for user 36b26040882a4e85b82b40a3c17d33bb and project 95f59687b3b24c7f9095bcb5fb909a67. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:20:20.643605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:20:20.646087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:20:20.782477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ad5c23c1-030e-4ca4-843f-ad0c32ee00b2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.666316 Oct 06 08:20:20.783158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 409/806] 10.222.0.30 () {62 vars in 1188 bytes} [Thu Oct 6 08:20:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 06 08:20:20.794699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:20.795448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:20.853548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:20.861060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:20.863855 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:20.864980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c3ba485c-3e7f-4330-8be1-a522c1dfc05f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1282 microversion: 2.20 time: 0.074211 Oct 06 08:20:20.865535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 398/807] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:20 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:21.504677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:21.505640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:21.512275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:21.512760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:21.513202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:21.513891 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:21.514378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:21.514815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:21.649631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:21.657772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-769ad094-86da-4c8f-84f9-5ef36a5e7101 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.157936 Oct 06 08:20:21.658479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 410/808] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:21 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:21.890394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:21.891017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:21.898128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:21.898607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:21.899074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:21.899752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:21.900219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:21.900614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:21.960054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:21.967897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:21.969335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:21.970419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-37133ec9-ab16-4ba5-b51b-9907f25a66a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1286 microversion: 2.20 time: 0.084014 Oct 06 08:20:21.970982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 399/809] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:21 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:22.681428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:22.682072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:22.688660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:22.689135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:22.689562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:22.690239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:22.690781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:22.691590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:22.825698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:22.834202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-84ace793-9899-4cee-bbfa-b9f954056f6d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.156635 Oct 06 08:20:22.834768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 411/810] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:22 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:22.996055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:22.996656 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:23.005004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:23.005490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:23.005921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:23.006610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:23.007093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:23.007513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:23.071905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:23.080042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:23.082224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:23.083573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f118a268-07f4-4859-b705-291c5b9cf441 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1334 microversion: 2.20 time: 0.091437 Oct 06 08:20:23.087856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 400/811] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:22 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:23.857770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:23.858363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:23.865657 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:23.866139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:23.866576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:23.867303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:23.867781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:23.868203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:24.056747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:24.064680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ad46c9ec-32f9-4494-a4a2-7658e1601921 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.210789 Oct 06 08:20:24.065258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 412/812] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:23 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:24.109651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:24.110215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:24.117830 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:24.118316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:24.118751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:24.119472 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:24.119931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:24.120510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:24.185684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:24.195800 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:24.197283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:24.198417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-327565e5-0f0e-4fed-847d-110616c787e0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1352 microversion: 2.20 time: 0.093165 Oct 06 08:20:24.198995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 401/813] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:24 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:25.088045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:25.089014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:25.110770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:25.110770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:25.110770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:25.110770 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:25.111169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:25.111169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:25.228419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:25.229032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:25.236513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:25.236985 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:25.237517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:25.238220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:25.238675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:25.239138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:25.243585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:25.304006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:25.312587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6b2e8935-6f75-4106-b289-2a6530508e8d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.228541 Oct 06 08:20:25.318856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 413/814] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:25 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:25.402572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:25.412041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:25.413511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:25.414629 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-66f65792-b784-46f3-82b6-4652fa97c03d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.190224 Oct 06 08:20:25.415304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 402/815] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:25 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:26.002090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:26.014764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.015292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.015719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.027302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] Creating event network-changed:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:20:26.032410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-d1d1a82f-cd4e-47f5-9e7e-751dc0936867 req-056a3ed7-0f51-43fd-9569-c16d2f4af458 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034079 Oct 06 08:20:26.033015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 414/816] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:26.336826 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:26.337431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:26.344199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.344681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.345113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.345798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.346247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.347328 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.439814 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:26.440518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:26.447330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.447825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.448264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.448967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.449421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.449847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.454106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:26.488321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:26.496342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c84aeda5-bd1e-42dc-b5c9-133f33cbffbb tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.163685 Oct 06 08:20:26.497028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 403/817] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:26 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:26.666405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:26.674653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:26.678757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:26.678757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-958e6d78-4ac0-4f1c-8793-adfec2cff307 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.241952 Oct 06 08:20:26.678757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 415/818] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:26 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:26.860510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf52209-2aa9-40ad-8cf5-76c38ac74b41", "name": "network-vif-plugged", "status": "completed", "tag": "9f9ef7e0-f04d-4b74-b05b-a57559617076"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:26.869657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:26.870137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:26.870566 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:26.882534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] Creating event network-vif-plugged:9f9ef7e0-f04d-4b74-b05b-a57559617076 for instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 on hv-cinder-86021 Oct 06 08:20:26.887959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-24e7776d-a0a3-4a4d-955d-d02c7ea38849 req-6665a9d5-cb6d-4303-b1fc-12b311a208f7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090586 Oct 06 08:20:26.888724 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 404/819] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:27.519629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:27.520274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:27.526798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:27.527315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:27.527753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:27.528436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:27.528923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:27.529348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:27.661971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:27.669636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3720b04d-3315-46ac-a51c-a579d41eff78 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.153960 Oct 06 08:20:27.670197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 416/820] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:27 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:27.704560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:27.705246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:27.711768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:27.712249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:27.712676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:27.713363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:27.713814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:27.714235 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:27.847090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:27.855175 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:27.856626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:27.857729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-956a1174-4bb7-4463-a4f3-0eb95439f36c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.157927 Oct 06 08:20:27.858289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 405/821] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:27 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:28.692502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:28.693138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:28.699662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:28.700151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:28.700591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:28.701315 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:28.701773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:28.702201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:28.834429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:28.841616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6ce36ca8-36f5-4d04-a581-2bd6b98efcc8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.153515 Oct 06 08:20:28.842186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 417/822] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:28 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:28.885784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:28.886372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:28.892787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:28.893264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:28.893725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:28.894607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:28.895086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:28.895511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:29.025352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:29.033408 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:29.034900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:29.036040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c09f1a16-9476-40e7-87aa-15cbe5ab3294 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.155929 Oct 06 08:20:29.036598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 406/823] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:28 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:29.864061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:29.864677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:29.871160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:29.871644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:29.872084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:29.872772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:29.873230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:29.873656 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:30.003051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:30.010924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8b6e127b-0f94-404a-9e7e-d608e358b07f tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.151148 Oct 06 08:20:30.011518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 418/824] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:29 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:30.061184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:30.061804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:30.068407 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:30.068894 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:30.069333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:30.070022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:30.070478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:30.070906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:30.197906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:30.207626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:30.209081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:30.210214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fd1f4787-805e-4041-a148-f2dd7bcdfc4a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.152919 Oct 06 08:20:30.210768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 407/825] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:30 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:31.033689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:31.035319 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:31.037147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:31.037823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=16 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:31.043013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:31.046384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:31.046384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:31.046384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:31.046384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:31.046739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:31.218715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:31.226991 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2bd0f00e-a76b-49ce-bb45-6b2d11b43b1c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1367 microversion: 2.1 time: 0.197091 Oct 06 08:20:31.227579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 419/826] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:31 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:31.236104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:31.236720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:31.239123 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=8 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:31.244448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:31.244943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:31.245425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:31.246129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:31.246588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:31.247050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:31.384722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:31.392978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:31.395496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:31.396628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-aecd57ea-16b1-4cd7-b553-ba53813cda51 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.164665 Oct 06 08:20:31.397183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 408/827] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:31 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:32.250146 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:32.250767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:32.257079 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.257557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.257994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.258680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.259193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.259615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.422124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:32.422726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:32.430109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.431273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.431779 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.432432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.433517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.433959 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.451453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:32.459625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ca734805-7c3b-4411-8570-362ce07aa452 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1557 microversion: 2.1 time: 0.213334 Oct 06 08:20:32.460202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 420/828] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:32 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:32.483243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:32.483737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:32.489933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.490419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.490858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.491581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.492034 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.492457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.567175 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:32.572455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-281fcfbe-7516-4095-be10-af7a67c05004 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093049 Oct 06 08:20:32.575149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 421/829] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:20:32 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:32.578958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:32.580532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:32.582760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3ec07ed5-4018-4714-a26d-2f51b17562d0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.164760 Oct 06 08:20:32.583370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 409/830] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:32 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:20:32.817899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "name": "network-vif-plugged", "status": "completed", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:32.827811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:32.828358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:32.828875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:32.841858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] Creating event network-vif-plugged:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:20:32.848054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-fe05e258-c642-4b87-b5bb-71c56b940699 req-ae8c0dbf-cc07-4137-b1e7-2e819438ade4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034824 Oct 06 08:20:32.848657 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 422/831] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:33.580037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf52209-2aa9-40ad-8cf5-76c38ac74b41", "tag": "9f9ef7e0-f04d-4b74-b05b-a57559617076"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:33.591067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:33.591548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:33.593061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:33.607439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] Creating event network-changed:9f9ef7e0-f04d-4b74-b05b-a57559617076 for instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 on hv-cinder-86021 Oct 06 08:20:33.614323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-ab0d329b-f9d0-4756-8a28-a162eb4a3022 req-4304550f-ae1b-4062-8d54-761455e0cef1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037843 Oct 06 08:20:33.616150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 423/832] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:33.621918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:33.622614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:33.628684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-189971562"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:33.629367 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:33.629589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:33.630074 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:33.630697 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:33.631607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:33.632225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:33.632836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:33.636494 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:33.637309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:33.637762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:33.638463 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:33.638913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:33.639565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:33.796402 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.network.security_group_api [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Removing security group 419fef34-2938-4488-8acd-4fa656ff87cc from port acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 Oct 06 08:20:33.807892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:33.817122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:33.818609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:33.819773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f521f897-63aa-4c28-9e1a-e56d240c63a1 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.201942 Oct 06 08:20:33.824853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 424/833] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:33 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:34.216289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9cef2cc1-ef98-4661-a1bd-f20a290f5725 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action" status: 202 len: 0 microversion: 2.1 time: 0.718074 Oct 06 08:20:34.217144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 410/834] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:20:33 2022] POST /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:20:34.845486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:34.846087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:34.856276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:34.856757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:34.857189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:34.858117 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:34.858968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:34.859398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:35.001357 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:35.015541 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:35.017019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:35.018124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-99af47e2-5d4e-4498-9b02-c66b187c455c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1407 microversion: 2.20 time: 0.176565 Oct 06 08:20:35.019312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 425/835] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:34 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:35.655206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:35.669957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:35.669957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:35.669957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:35.677795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] Creating event network-changed:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:20:35.682886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-935a5ec1-b2f4-4434-92c5-6c16514d2ae3 req-e84acf91-d4fc-42cc-af1f-d8700e7e9cfd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031882 Oct 06 08:20:35.683595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 411/836] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:35.763850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:35.764348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:35.770304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:35.770779 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:35.771237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:35.771919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:35.772363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:35.772782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:35.870322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lazy-loading 'services' on Instance uuid b8cfed38-1eff-4626-989e-55d8c058a147 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:36.046531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:36.048136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:36.054877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.055615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.056204 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.057039 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.057732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.058310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.144336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ed3620ce-8a34-4ed5-83a4-9b52ec13fe77 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments/7963166e-f4fe-4f7a-9d6c-fd1c2f437111" status: 202 len: 0 microversion: 2.1 time: 0.383314 Oct 06 08:20:36.163548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 426/837] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:20:35 2022] DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments/7963166e-f4fe-4f7a-9d6c-fd1c2f437111 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:20:36.173484 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:36.178408 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:36.186618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.187574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.188177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.189082 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.192613 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.194214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.230480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:36.236840 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1d2ec09c-f42e-4901-a527-443f9f1ebe05 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067662 Oct 06 08:20:36.238491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 427/838] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:36 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:36.240619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:36.242069 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:36.244692 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-17be1c02-1ac2-4b62-80bf-2c7deee93718 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1599 microversion: 2.20 time: 0.202582 Oct 06 08:20:36.245612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 412/839] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:20:36 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1599 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:20:36.273267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:36.273785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:36.279827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.280310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.280821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.281456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:36.281903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:36.282324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:36.380365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-23e1d735-5fb1-4972-bf50-44636a9e4aeb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.111021 Oct 06 08:20:36.381094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 428/840] 10.222.0.30 () {60 vars in 1316 bytes} [Thu Oct 6 08:20:36 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:20:37.250273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:37.253203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:37.260567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:37.261327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:37.261757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:37.262455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:37.262905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:37.263429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:37.295758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4a906a2e-a2e9-41a2-a5c8-3d5ba921c399 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049755 Oct 06 08:20:37.296349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 413/841] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:37 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:37.711227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:37.720611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:37.721093 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:37.722309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:37.735461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] Creating event network-changed:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:20:37.742633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-05b997d1-1625-45aa-a421-b799294a0f72 req-a83fc59e-c40b-4b81-9011-a4b77e946e6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035626 Oct 06 08:20:37.743804 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 429/842] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:37.789571 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:37.801759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:37.802262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:37.802880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:37.816198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] Creating event network-changed:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:20:37.822452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-a4e00914-cb4c-4ba3-ad55-5bc0669a600c req-703004d3-58cc-449b-8f7e-00226f1df8c8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036222 Oct 06 08:20:37.825374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 414/843] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:20:38.309801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:38.312132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:38.319393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:38.319715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:38.320197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:38.320981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:38.321417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:38.321837 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:38.352850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-43d55c3f-ebb9-4888-9a60-29410f33f23e tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047511 Oct 06 08:20:38.353629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 430/844] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:20:38 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:20:38.364468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:38.365040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:38.372024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:38.372508 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:38.372937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:38.373628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:38.374078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:38.374496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:38.475647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] HTTP exception thrown: Instance b8cfed38-1eff-4626-989e-55d8c058a147 is not attached to volume 7963166e-f4fe-4f7a-9d6c-fd1c2f437111 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Request method failure captured: Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments/7963166e-f4fe-4f7a-9d6c-fd1c2f437111 HTTP/1.1 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo6bFSRaUiFdKfiDXiyS2j6GIOH4f6vSYdlDguHixywLP2N1H2EmzlvegkLNVJm4k8dAKYeCUotYRruhx36cpiGHN4aaUAvRCLii-8JxiTJQv0GPFn2b1De7Fg4vF5ZZpSxNo09W5k45iLC0SUWiVLMl7hYspmuFS3mcjbaiRgM6APA Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 9b4d6dd628464c05b707fee1dd32f04a Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:20:38.479070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 9b4d6dd628464c05b707fee1dd32f04a Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-TestMinimumBasicScenario-1631741863-project Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: e767c7081875428382af11d1ff475a20 Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-TestMinimumBasicScenario-1631741863-project Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:20:38.480510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance b8cfed38-1eff-4626-989e-55d8c058a147 is not attached to volume 7963166e-f4fe-4f7a-9d6c-fd1c2f437111 Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'server_id': 'b8cfed38-1eff-4626-989e-55d8c058a147', 'id': '7963166e-f4fe-4f7a-9d6c-fd1c2f437111'} Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7963166e-f4fe-4f7a-9d6c-fd1c2f437111. Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:20:38.481252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cfed38-1eff-4626-989e-55d8c058a147 is not attached to volume 7963166e-f4fe-4f7a-9d6c-fd1c2f437111 Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cfed38-1eff-4626-989e-55d8c058a147 is not attached to volume 7963166e-f4fe-4f7a-9d6c-fd1c2f437111 Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:20:38.482470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Returning 404 to user: Instance b8cfed38-1eff-4626-989e-55d8c058a147 is not attached to volume 7963166e-f4fe-4f7a-9d6c-fd1c2f437111 {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:20:38.483665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-25bf23ce-f0c7-4b1c-9ca6-a6e83791e87b tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments/7963166e-f4fe-4f7a-9d6c-fd1c2f437111" status: 404 len: 154 microversion: 2.1 time: 0.120669 Oct 06 08:20:38.488909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 415/845] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:20:38 2022] DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147/os-volume_attachments/7963166e-f4fe-4f7a-9d6c-fd1c2f437111 => generated 154 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:20:39.788015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:39.788498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:39.794956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:39.795445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:39.795877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:39.796561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:39.797009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:39.797429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:39.822069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:20:40.134789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-55824b64-516f-4a1b-8aac-5a9aae8b8226 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 204 len: 0 microversion: 2.1 time: 0.350438 Oct 06 08:20:40.135426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 431/846] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:20:39 2022] DELETE /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:20:40.144090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:40.148080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:40.152597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:40.153094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:40.153537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:40.154232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:40.154684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:40.155248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:40.285521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:40.293356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ac6541d6-b181-497f-b86e-8ef15466a63f tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1556 microversion: 2.1 time: 0.153189 Oct 06 08:20:40.293915 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 416/847] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:40 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:41.318642 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:41.319294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:41.325821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:41.326301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:41.326733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:41.327443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:41.327893 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:41.328311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:41.331733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:41.462475 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:41.469980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-90ccf270-08b9-45e9-87ed-d98ee5b26237 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1556 microversion: 2.1 time: 0.156330 Oct 06 08:20:41.470547 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 432/848] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:41 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:42.493288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:42.493960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:42.497525 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:42.501010 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:42.501499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:42.501939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:42.502844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:42.503584 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:42.503947 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:42.660384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:42.668332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9e78b652-299b-4f21-be50-18c792e4a642 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1556 microversion: 2.1 time: 0.178811 Oct 06 08:20:42.669997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 417/849] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:42 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:43.123305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8cfed38-1eff-4626-989e-55d8c058a147", "name": "network-vif-deleted", "tag": "acbd5de6-aa30-4ab0-b9c6-10cba96a0be1"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:20:43.134835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:43.138196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:43.138196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:43.148040 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] Creating event network-vif-deleted:acbd5de6-aa30-4ab0-b9c6-10cba96a0be1 for instance b8cfed38-1eff-4626-989e-55d8c058a147 on hv-cinder-86021 Oct 06 08:20:43.153055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-69b0aacc-7d23-4a67-8e1b-b653db40b3fa req-4c423859-43fe-4a5c-8b80-cc3bd6dfc228 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Oct 06 08:20:43.153740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 433/850] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:20:43.692403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:43.693243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:43.699663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:43.700145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:43.700578 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:43.701267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:43.701892 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:43.702315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:43.736024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:43.736516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:43.737203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:43.737671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lazy-loading 'fault' on Instance uuid b8cfed38-1eff-4626-989e-55d8c058a147 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:20:43.781668 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e767c7081875428382af11d1ff475a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4d6dd628464c05b707fee1dd32f04a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:20:43.790583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6cf0cbf6-58a0-4a51-ae02-3cf9a9c47277 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 200 len: 1349 microversion: 2.1 time: 0.102137 Oct 06 08:20:43.791225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 418/851] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:43 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:20:44.814739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:44.816068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] [instance: b8cfed38-1eff-4626-989e-55d8c058a147] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:20:44.817955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:20:44.822782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:44.823334 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:44.830630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:44.830630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:20:44.830630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:20:44.830630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:20:44.838388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] HTTP exception thrown: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Request method failure captured: Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 HTTP/1.1 Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo6bFSRaUiFdKfiDXiyS2j6GIOH4f6vSYdlDguHixywLP2N1H2EmzlvegkLNVJm4k8dAKYeCUotYRruhx36cpiGHN4aaUAvRCLii-8JxiTJQv0GPFn2b1De7Fg4vF5ZZpSxNo09W5k45iLC0SUWiVLMl7hYspmuFS3mcjbaiRgM6APA Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 9b4d6dd628464c05b707fee1dd32f04a Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:20:44.840054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9b4d6dd628464c05b707fee1dd32f04a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 9b4d6dd628464c05b707fee1dd32f04a Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1631741863 Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-TestMinimumBasicScenario-1631741863-project Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: e767c7081875428382af11d1ff475a20 Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-TestMinimumBasicScenario-1631741863-project Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. Oct 06 08:20:44.841404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'b8cfed38-1eff-4626-989e-55d8c058a147'} Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:20:44.842145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. Oct 06 08:20:44.843661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:20:44.844992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Returning 404 to user: Instance b8cfed38-1eff-4626-989e-55d8c058a147 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:20:44.844992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-65377773-723f-4eb7-b167-3557f635ab66 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147" status: 404 len: 111 microversion: 2.1 time: 0.031458 Oct 06 08:20:44.844992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 434/852] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:20:44 2022] GET /compute/v2.1/servers/b8cfed38-1eff-4626-989e-55d8c058a147 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:20:44.851295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7e6b760d-2932-4849-8071-8cb1257ce684 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] Calling method '.version_select at 0x7f9237b6f3a0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:20:44.930260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7e6b760d-2932-4849-8071-8cb1257ce684 tempest-TestMinimumBasicScenario-1631741863 tempest-TestMinimumBasicScenario-1631741863-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1602971688" status: 202 len: 0 microversion: 2.1 time: 0.083728 Oct 06 08:20:44.930767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 419/853] 10.222.0.30 () {58 vars in 1272 bytes} [Thu Oct 6 08:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1602971688 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:21:06.313330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:06.315501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:06.317978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=9 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:06.323871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.324359 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.324791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.325489 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.325943 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.326432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.358438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c6343615-49e6-4628-8221-a4a5f791a1c2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049527 Oct 06 08:21:06.359017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 435/854] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:21:06 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:21:06.427180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:06.427704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:06.430251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=89 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:06.431038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:06.435605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.440840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.440840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.440840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.440840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.441257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.464445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:21:06.728789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-24e3d361-1b22-4bc1-8ed6-150f104a9c64 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 204 len: 0 microversion: 2.1 time: 0.305068 Oct 06 08:21:06.729302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 420/855] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:21:06 2022] DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:21:06.737706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:06.743601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:06.744753 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.745231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.745664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.746343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:06.746821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:06.747267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:06.873968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:06.882501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b99f5e84-59c9-4ea7-92ef-100c8ea379f5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1672 microversion: 2.1 time: 0.148826 Oct 06 08:21:06.883097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 436/856] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:06 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:07.905799 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:07.906525 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:07.913149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:07.913634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:07.914072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:07.914765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:07.915255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:07.915687 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:08.044001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:08.051560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-60f0546b-4c68-40e5-8826-14fe0c23187c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1672 microversion: 2.1 time: 0.150048 Oct 06 08:21:08.052116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 421/857] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:07 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:08.654281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:08.654842 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:08.661486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:08.661976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:08.662594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:08.663337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:08.663746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:08.664178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:08.748654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'services' on Instance uuid 77274032-7602-49f0-8811-7ba4a0b369a4 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:08.980418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e89d331d-054c-46be-a250-7dd4482f859e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments/450efac6-a84a-491d-be4d-4febdcd22c52" status: 202 len: 0 microversion: 2.1 time: 0.330053 Oct 06 08:21:08.981029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 437/858] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:21:08 2022] DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments/450efac6-a84a-491d-be4d-4febdcd22c52 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:21:08.989306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:08.992591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:08.999355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:08.999853 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:09.000295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:09.001002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:09.001458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:09.001942 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:09.034063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-42a5a09b-22ea-40da-bc15-b815714d2904 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048574 Oct 06 08:21:09.034590 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 422/859] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:21:08 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:09.044975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a957af7c-67a0-48fd-9982-e38551889d44", "name": "network-vif-deleted", "tag": "7d45a844-7a13-48a7-b30a-540bde162269"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:09.056618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:09.057126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:09.057555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:09.068992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] Creating event network-vif-deleted:7d45a844-7a13-48a7-b30a-540bde162269 for instance a957af7c-67a0-48fd-9982-e38551889d44 on hv-cinder-86021 Oct 06 08:21:09.075571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-c6cbd369-ddc4-4bac-aed7-6025d08f7930 req-840e3aed-8276-478d-b6e7-4857d6209051 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Oct 06 08:21:09.075571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 438/860] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:09.075827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:09.076176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:09.082417 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:09.082968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:09.083421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:09.084727 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:09.085251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:09.085708 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:09.161834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:09.171342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ecce9df8-2a86-4d2a-af03-ea828a2edbb6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1605 microversion: 2.1 time: 0.100225 Oct 06 08:21:09.188556 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 423/861] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:09 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1605 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:10.048190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:10.050345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:10.056871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:10.057363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:10.057808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:10.058494 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:10.058956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:10.059394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:10.090267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-62a98c70-113d-42bb-8ea7-158d62286c27 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046890 Oct 06 08:21:10.090826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 439/862] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:21:10 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:10.195809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:10.196418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:10.203095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:10.203587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:10.204029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:10.204720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:10.205447 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:10.205877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:10.239208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:10.239685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:10.240116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:10.240749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lazy-loading 'fault' on Instance uuid a957af7c-67a0-48fd-9982-e38551889d44 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:10.285393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:10.294049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fd325152-d840-4bc4-b4c8-8c78990d3af2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 200 len: 1327 microversion: 2.1 time: 0.102057 Oct 06 08:21:10.294619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 424/863] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:10 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:11.102545 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:11.104752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:11.111173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.111662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.112100 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.112810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.113264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.113687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.149230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ede93bba-89ab-4cb3-b0b5-b432fa371980 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050203 Oct 06 08:21:11.151305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 440/864] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:21:11 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:21:11.234977 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:11.235488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:11.242774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.243306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.244595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.245294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.245746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.246169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.271127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:21:11.321900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:11.322507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:11.328403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.328894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.329332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.330013 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.330464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.330887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.345026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 HTTP/1.1 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:21:11.346588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:21:11.348204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'a957af7c-67a0-48fd-9982-e38551889d44'} Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:21:11.349208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:21:11.350781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:11.352162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:21:11.352162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e0e3cbd8-8eb0-4f36-ab09-47a97e6a2a52 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 404 len: 111 microversion: 2.1 time: 0.031345 Oct 06 08:21:11.352162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 441/865] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:11 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:21:11.357549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9a61574e-0539-4e88-8291-248cda191801 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '.version_select at 0x7f923f3f2700>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:11.461928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9a61574e-0539-4e88-8291-248cda191801 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141205780" status: 202 len: 0 microversion: 2.1 time: 0.107575 Oct 06 08:21:11.462421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 442/866] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Oct 6 08:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141205780 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:21:11.574884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6fa272f3-fb45-429d-b646-235ffdce0135 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 204 len: 0 microversion: 2.1 time: 0.343503 Oct 06 08:21:11.576852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 425/867] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:21:11 2022] DELETE /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:21:11.583554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:11.585312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:11.593351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.593838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.594279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.595142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:11.595543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:11.595967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:11.808694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:11.816538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-55f96df9-72f1-43e7-a8aa-52ee89a997a5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1688 microversion: 2.1 time: 0.236855 Oct 06 08:21:11.817108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 443/868] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:11 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1688 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:12.230268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bab88a84-2abe-465e-8692-5f81826b088c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: .version_select at 0x7f9237bb7700>, body: {"keypair": {"name": "tempest-keypair-297271825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuCdZztJhBvopj+1qb44NNgMK65HGFsRd41t1HF/gIJcprTJQ9Bcy/fZwAU9zEuwZXL2BwUQJ22zi7s9clM68nNWX8gb5VgnquYf5TTh1PgsMJNugA7EhNMLkRhBWmGtw=="}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:12.246411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-bab88a84-2abe-465e-8692-5f81826b088c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for project 73f960dc36054e9ba7003628a82b7039. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:21:12.250505 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-bab88a84-2abe-465e-8692-5f81826b088c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for user cb73bbd331754280a2a0cd64290ec3c8 and project 73f960dc36054e9ba7003628a82b7039. Resources: {'key_pairs'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:21:12.375426 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bab88a84-2abe-465e-8692-5f81826b088c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.149407 Oct 06 08:21:12.376023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 426/869] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:21:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:12.841739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:12.842382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:12.849116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:12.849607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:12.850072 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:12.850954 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:12.851422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:12.851847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:12.997845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:13.005633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-38cf6e3a-59d9-43d8-81c6-e01c89a49589 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1688 microversion: 2.1 time: 0.167963 Oct 06 08:21:13.007857 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 444/870] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:12 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:14.030029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:14.030757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:14.038769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:14.039393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:14.039841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:14.040645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:14.041105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:14.041537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:14.187545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:14.195924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cdbb9661-266b-482c-8118-27c9c19c0a4e tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1688 microversion: 2.1 time: 0.170086 Oct 06 08:21:14.196525 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 427/871] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:14 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:14.554295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-667965113", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18fda9e7-3500-4ee8-bef0-caac3b366832"}], "security_groups": [{"name": "tempest-securitygroup--820706097"}], "key_name": "tempest-keypair-297271825", "user_data": "}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:14.657014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] validate_networks() for [('18fda9e7-3500-4ee8-bef0-caac3b366832', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:21:15.031528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:21:15.031952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:21:15.032425 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:21:15.032831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:21:15.033361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:21:15.048020 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:15.048513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:15.048944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:15.049665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:15.050128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:15.050526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:15.067532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for project 73f960dc36054e9ba7003628a82b7039. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:21:15.072432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Getting quotas for user cb73bbd331754280a2a0cd64290ec3c8 and project 73f960dc36054e9ba7003628a82b7039. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:21:15.083453 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:21:15.086483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:21:15.218698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:15.219354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:15.226514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:15.227022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:15.229975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:15.229975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:15.229975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:15.229975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:15.233982 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4a578008-1e39-4085-bf79-2f7ebb965ccd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.684018 Oct 06 08:21:15.234865 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 445/872] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:21:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:21:15.246323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-268c5448-89ff-4351-9e6a-c1fba3ca6cb2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:15.246928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-268c5448-89ff-4351-9e6a-c1fba3ca6cb2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:15.325192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-268c5448-89ff-4351-9e6a-c1fba3ca6cb2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:15.333544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-268c5448-89ff-4351-9e6a-c1fba3ca6cb2 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1236 microversion: 2.1 time: 0.090892 Oct 06 08:21:15.342415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 446/873] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:15 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:15.379514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:15.388473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f1556f77-3d5d-453e-a0b1-073eca24bb4c tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1688 microversion: 2.1 time: 0.173661 Oct 06 08:21:15.389051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 428/874] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:15 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:16.231337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77274032-7602-49f0-8811-7ba4a0b369a4", "name": "network-vif-deleted", "tag": "d7bf27c0-5505-4862-b093-a5d472ca0fed"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:16.249094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:16.249823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:16.250254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:16.263096 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] Creating event network-vif-deleted:d7bf27c0-5505-4862-b093-a5d472ca0fed for instance 77274032-7602-49f0-8811-7ba4a0b369a4 on hv-cinder-86021 Oct 06 08:21:16.268351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-a95e244b-f6e4-40c2-84aa-a138621947d9 req-8c80c8fd-fb91-4779-83bf-c56e2182526a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040577 Oct 06 08:21:16.268941 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 447/875] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:16.358829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:16.359489 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:16.369018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:16.369314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:16.369759 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:16.370478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:16.371008 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:16.371425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:16.414745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:16.423600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:16.435798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:16.452434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:16.453241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:16.455119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:16.458882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:16.461581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:16.486312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:16.495675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-41d3fdae-f0dc-47c8-85c3-14740596745f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1232 microversion: 2.1 time: 0.142405 Oct 06 08:21:16.497847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 429/876] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:16 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1232 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:16.544426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:16.552467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7e170e51-cec0-465f-8b68-cbd0e54993a0 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1329 microversion: 2.1 time: 0.143543 Oct 06 08:21:16.558157 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 448/877] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:16 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1329 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:17.523319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:17.523927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:17.530322 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:17.530804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:17.531302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:17.531983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:17.532434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:17.532854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:17.576097 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:17.576739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:17.583260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:17.583689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:17.584126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:17.585342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:17.585792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:17.586215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:17.598490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:17.607516 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a2a1c339-8801-4529-9af7-2b9167c728b9 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1306 microversion: 2.1 time: 0.088750 Oct 06 08:21:17.608527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 430/878] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:17 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:17.618531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:17.619045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:17.619482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:17.619926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'fault' on Instance uuid 77274032-7602-49f0-8811-7ba4a0b369a4 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:17.675749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:17.685716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7cd3358e-da0d-4dc2-a3af-66660f1db0e5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 200 len: 1334 microversion: 2.1 time: 0.112824 Oct 06 08:21:17.686695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 449/879] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:17 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 1334 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:18.630609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:18.631185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:18.638367 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:18.638881 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:18.639916 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:18.640637 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:18.641097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:18.641523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:18.710694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:18.711483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 77274032-7602-49f0-8811-7ba4a0b369a4] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:18.718536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:18.719058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:18.719518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:18.720186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:18.720635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:18.721051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:18.743937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] HTTP exception thrown: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Request method failure captured: Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 HTTP/1.1 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44j6z1K7FntfimuG7BkJKrChOjKGGCi5vuzxL-ui6Bp-YO32gSJx4zy2G39zbq51zSDmHHFfcfrB03Iy_d74SNl-XapWbJ52_BbNogPBAS8audB8QW9qei9izScHPCOpnZFm0XPfi6jMi6024YJFt72cKBONXVQcdR9Hvx2yjMP3w Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:21:18.745644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 85bdfc4b6ad443d68ebc0d6932ccad66 Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. Oct 06 08:21:18.747239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '77274032-7602-49f0-8811-7ba4a0b369a4'} Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:21:18.748149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. Oct 06 08:21:18.752511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:18.753790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Returning 404 to user: Instance 77274032-7602-49f0-8811-7ba4a0b369a4 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:21:18.753790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5672e01d-e264-439e-9971-7a5325b756d9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4" status: 404 len: 111 microversion: 2.1 time: 0.041138 Oct 06 08:21:18.753790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 450/880] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:18 2022] GET /compute/v2.1/servers/77274032-7602-49f0-8811-7ba4a0b369a4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:21:18.758795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-750b204f-7f4b-49b2-8365-e7cdd4ca6fa5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '.version_select at 0x7f923f364040>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:18.785063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:18.793490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e364b78e-3d99-449c-a8bd-89ad2a0ee662 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.166750 Oct 06 08:21:18.795905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 431/881] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:18 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:18.873439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-750b204f-7f4b-49b2-8365-e7cdd4ca6fa5 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372537538" status: 202 len: 0 microversion: 2.1 time: 0.119051 Oct 06 08:21:18.877278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 451/882] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Oct 6 08:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372537538 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:21:19.677437 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be", "tag": "0d871f00-3696-4ce9-9f48-5d50bb9856a4"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:19.688697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:19.689187 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:19.689624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:19.701364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] Creating event network-changed:0d871f00-3696-4ce9-9f48-5d50bb9856a4 for instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be on hv-cinder-86021 Oct 06 08:21:19.706471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-c5f40043-25b1-4d9d-a527-7ef5413385b9 req-4571564f-7d7d-4605-ac11-b0f1b60c4a4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032724 Oct 06 08:21:19.707298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 432/883] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:19.817889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:19.818524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:19.828817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:19.829312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:19.829745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:19.830837 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:19.830997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:19.835467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:20.049283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:20.056950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0eff5f71-6525-41c7-911c-33f83bf34a8a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.243523 Oct 06 08:21:20.057534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 452/884] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:19 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:21.081695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:21.082420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:21.089117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:21.089609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:21.090058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:21.090743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:21.091223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:21.091652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:21.234172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:21.242394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-408dd56c-c0cf-46ff-8074-f47cb3b5e686 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.165306 Oct 06 08:21:21.242926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 433/885] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:21 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:22.237985 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:22.238476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:22.245016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.245435 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.245865 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.246544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.247024 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.247448 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.265708 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:22.266377 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:22.268880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=4 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:22.273356 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:21:22.274582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.275249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.275672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.276367 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.276820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.277243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.295716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:22.410769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:22.418788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5d3deadc-d8c0-4ddf-95a9-295272e56abd tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.157272 Oct 06 08:21:22.419371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 434/886] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:22 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:21:22.545678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2e43039c-acf6-4d5e-9c2a-0317275fb9fa tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 204 len: 0 microversion: 2.1 time: 0.311145 Oct 06 08:21:22.546194 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 453/887] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:21:22 2022] DELETE /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:21:22.554489 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:22.555122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:22.561567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.566509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.566509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.566509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:22.566509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:22.566921 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:22.691173 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:22.700225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-946e8ac1-038b-474b-990e-35222f9c7751 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1505 microversion: 2.1 time: 0.149971 Oct 06 08:21:22.700804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 435/888] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:22 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:23.441868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:23.442478 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:23.449106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:23.449585 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:23.450023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:23.450701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:23.451183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:23.451611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:23.581459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:23.590131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-bcda0b92-dcac-4715-b828-cedb26525162 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.152589 Oct 06 08:21:23.590698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 454/889] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:23 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:23.723531 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:23.724050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:23.730411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:23.730891 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:23.731352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:23.732030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:23.732483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:23.732904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:23.858311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:23.866132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a51a9818-8111-441e-a3e0-46d27e862f05 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1505 microversion: 2.1 time: 0.146298 Oct 06 08:21:23.866768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 436/890] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:23 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:24.494962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812fed79-2558-4d6b-b256-d23f79d7c85c", "name": "network-vif-deleted", "tag": "f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:24.505406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.505883 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.506345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.510378 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:24.517781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] Creating event network-vif-deleted:f0a5c1ef-20ed-49cb-91ed-cf8caa32fda9 for instance 812fed79-2558-4d6b-b256-d23f79d7c85c on hv-cinder-86021 Oct 06 08:21:24.523018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-3db9109a-6ac4-4abe-a961-7bd83456f9af req-82d0dd01-8935-435a-a2ab-3687a30305d5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036164 Oct 06 08:21:24.523691 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 455/891] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:24.613841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:24.614449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:24.621592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.622075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.622541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.623318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.623777 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.624200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.760042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:24.769762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dee3a6e4-53f7-40fb-80aa-27bd1ca0344e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.159874 Oct 06 08:21:24.770350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 437/892] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:24 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:24.891116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:24.891969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:24.899581 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.900122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.900674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.901259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.901812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.902171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.933822 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:24.934299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:24.934730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:24.935195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'fault' on Instance uuid 812fed79-2558-4d6b-b256-d23f79d7c85c {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:24.979723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:24.987628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d0e29299-9121-4c05-84c3-2b77354ee701 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 200 len: 1311 microversion: 2.1 time: 0.101816 Oct 06 08:21:24.988199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 456/893] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:24 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:25.792767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:25.793534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:25.799731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:25.800229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:25.800647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:25.801323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:25.801770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:25.802185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:25.930597 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:25.938895 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-72669f90-f12a-43e1-9358-5187f2cd0ba0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.150120 Oct 06 08:21:25.939541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 438/894] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:25 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:26.011793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:26.015948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: 812fed79-2558-4d6b-b256-d23f79d7c85c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:26.015948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:26.015948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=8 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:26.021018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.021591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.022207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.022920 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.023413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.023844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.037563 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] HTTP exception thrown: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Request method failure captured: Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c HTTP/1.1 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44j6z1K7FntfimuG7BkJKrChOjKGGCi5vuzxL-ui6Bp-YO32gSJx4zy2G39zbq51zSDmHHFfcfrB03Iy_d74SNl-XapWbJ52_BbNogPBAS8audB8QW9qei9izScHPCOpnZFm0XPfi6jMi6024YJFt72cKBONXVQcdR9Hvx2yjMP3w Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:21:26.039228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 85bdfc4b6ad443d68ebc0d6932ccad66 Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. Oct 06 08:21:26.041039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '812fed79-2558-4d6b-b256-d23f79d7c85c'} Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:21:26.042602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. Oct 06 08:21:26.044018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:26.045298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Returning 404 to user: Instance 812fed79-2558-4d6b-b256-d23f79d7c85c could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:21:26.045298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-42e76db2-fcbb-49bd-abd6-1a861f8b1997 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c" status: 404 len: 111 microversion: 2.1 time: 0.033322 Oct 06 08:21:26.045298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 457/895] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:26 2022] GET /compute/v2.1/servers/812fed79-2558-4d6b-b256-d23f79d7c85c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:21:26.051149 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:26.051997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:26.059067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.059646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.060153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.060948 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.061472 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.061965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.088382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:21:26.500449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1d93dd02-faab-4613-8092-cf4780b75994 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 204 len: 0 microversion: 2.1 time: 0.453028 Oct 06 08:21:26.501041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 439/896] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:21:26 2022] DELETE /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:21:26.509200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:26.509797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:26.517232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.517706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.518134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.518808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.519281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.519751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.654710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:26.662463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3b143b36-a3d9-4c52-869b-ce9b0cbd8cf9 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.157216 Oct 06 08:21:26.663056 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 458/897] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:26 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:26.962701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:26.963343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:26.969836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.970324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.970760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:26.971487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:26.971942 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:26.972374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:27.106572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:27.114219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-782b0545-7b99-46aa-a923-bab8789dff95 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.155878 Oct 06 08:21:27.114807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 440/898] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:26 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:27.565726 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be", "name": "network-vif-plugged", "status": "completed", "tag": "0d871f00-3696-4ce9-9f48-5d50bb9856a4"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:27.575746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:27.576217 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:27.576637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:27.587525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] Creating event network-vif-plugged:0d871f00-3696-4ce9-9f48-5d50bb9856a4 for instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be on hv-cinder-86021 Oct 06 08:21:27.592561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-fc223f47-f192-46be-8f53-9439f3fa81af req-5f02d75f-1015-4edf-a61a-e452c8d442cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030593 Oct 06 08:21:27.593164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 459/899] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:27.686753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:27.688156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:27.694884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:27.695918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:27.696348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:27.697257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:27.698314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:27.698896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:27.841148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:27.849186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0682ce62-3eac-4ad7-9f8a-df81ba9545bf tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1519 microversion: 2.1 time: 0.167213 Oct 06 08:21:27.849972 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 441/900] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:27 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:28.138646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:28.139393 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:28.145718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:28.146207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:28.146644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:28.147523 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:28.147983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:28.148405 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:28.281329 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1084773-96dd-49ad-b6a7-11e7f90ba5b1", "name": "network-vif-deleted", "tag": "976a4aef-c6fd-42c8-aca2-3fb036d359e8"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:28.291499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:28.291969 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:28.292391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:28.304078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] Creating event network-vif-deleted:976a4aef-c6fd-42c8-aca2-3fb036d359e8 for instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 on hv-cinder-86021 Oct 06 08:21:28.309019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-f272187a-4b79-4efe-954b-9778791ddfcf req-d1d592a2-7035-431a-949b-2e1ffa35a906 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Oct 06 08:21:28.309648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 442/901] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:21:28.340730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:28.348499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e0a6de53-e715-4c9e-ba5e-3c886c9e6dec tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.215524 Oct 06 08:21:28.349104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 460/902] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:28 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:28.874922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:28.875543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:28.881605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:28.882082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:28.882512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:28.883231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:28.883682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:28.884099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:28.946657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:28.954663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3abf3534-6f1f-456f-9c3c-02fc19e1ec71 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1306 microversion: 2.1 time: 0.084814 Oct 06 08:21:28.955262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 443/903] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:28 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1306 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:29.370972 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:29.371758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:29.378282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:29.378767 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:29.379233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:29.379922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:29.380374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:29.380789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:29.518059 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:29.525888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-30e3ba74-f09d-4e7f-9042-9cb373aadb11 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1361 microversion: 2.1 time: 0.158794 Oct 06 08:21:29.526455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 461/904] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:29 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:29.978048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:29.978809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:29.988055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:29.988554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:29.988998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:29.989880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:29.990968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:29.991118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.029162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:30.029661 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:30.030083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.030524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lazy-loading 'fault' on Instance uuid e1084773-96dd-49ad-b6a7-11e7f90ba5b1 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:30.080177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85bdfc4b6ad443d68ebc0d6932ccad66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5f023bd0dcf41558003e085c1dddf30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:30.090541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7f52433e-fdbd-4ae7-acfb-a2cc43cf75d1 tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 200 len: 1311 microversion: 2.1 time: 0.116010 Oct 06 08:21:30.091393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 444/905] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:29 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:30.550212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:30.550886 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:30.557349 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:30.557832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:30.558269 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.559564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:30.560225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:30.560678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.695494 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:30.704880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3b1be2e7-2663-4346-8605-cdf6e3d7a767 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1546 microversion: 2.1 time: 0.158402 Oct 06 08:21:30.705473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 462/906] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:30 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:21:30.729010 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:30.729610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:30.738006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:30.742188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:30.742188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.742188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:30.742188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:30.742562 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:30.831287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1ebd7385-4d2b-4092-9507-10a575f9046b tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106368 Oct 06 08:21:30.831923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 445/907] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:21:30 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:21:31.114122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:31.114743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] [instance: e1084773-96dd-49ad-b6a7-11e7f90ba5b1] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:31.120678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:31.121233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:31.121778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:31.122349 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:31.122802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:31.123256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:31.137003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] HTTP exception thrown: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Request method failure captured: Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 HTTP/1.1 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44j6z1K7FntfimuG7BkJKrChOjKGGCi5vuzxL-ui6Bp-YO32gSJx4zy2G39zbq51zSDmHHFfcfrB03Iy_d74SNl-XapWbJ52_BbNogPBAS8audB8QW9qei9izScHPCOpnZFm0XPfi6jMi6024YJFt72cKBONXVQcdR9Hvx2yjMP3w Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:21:31.138655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d5f023bd0dcf41558003e085c1dddf30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d5f023bd0dcf41558003e085c1dddf30 Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1060539273 Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 85bdfc4b6ad443d68ebc0d6932ccad66 Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1060539273-project Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. Oct 06 08:21:31.145159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'e1084773-96dd-49ad-b6a7-11e7f90ba5b1'} Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:21:31.146314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. Oct 06 08:21:31.147751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:21:31.148898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] Returning 404 to user: Instance e1084773-96dd-49ad-b6a7-11e7f90ba5b1 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:21:31.148898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1eb135c2-15f1-472c-8597-68133e2ace9d tempest-ServerRescueNegativeTestJSON-1060539273 tempest-ServerRescueNegativeTestJSON-1060539273-project] 10.222.0.30 "GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1" status: 404 len: 111 microversion: 2.1 time: 0.029912 Oct 06 08:21:31.148898 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 463/908] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:21:31 2022] GET /compute/v2.1/servers/e1084773-96dd-49ad-b6a7-11e7f90ba5b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:21:32.077102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be", "tag": "0d871f00-3696-4ce9-9f48-5d50bb9856a4"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:32.092042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:32.092828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:32.093451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:32.105148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] Creating event network-changed:0d871f00-3696-4ce9-9f48-5d50bb9856a4 for instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be on hv-cinder-86021 Oct 06 08:21:32.111528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-96b75c97-49dd-4abb-aba3-4d84840ba54c req-22e97b90-c52b-4fd0-9497-0ccde34162fc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040312 Oct 06 08:21:32.112558 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 446/909] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:21:53.156457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:53.156958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:53.159699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:53.160757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=38 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:53.165794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:53.166280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:53.166715 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:53.167441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:53.167905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:53.168428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:53.197516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-85b6d9a9-fc5a-413f-8a4f-014b94fe8975 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/ips" status: 200 len: 151 microversion: 2.20 time: 0.046130 Oct 06 08:21:53.198107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 464/910] 10.222.0.30 () {60 vars in 1289 bytes} [Thu Oct 6 08:21:53 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:21:56.396634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:21:56.397182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:56.399614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:56.400387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:21:56.405068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:56.405561 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:56.406001 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:56.406694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:56.407178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:56.407634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:56.431086 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lazy-loading 'flavor' on Instance uuid f8211c04-50e4-43b1-9090-3d373f94a3c7 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:21:56.967847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8a212400-7ffb-44a0-af01-680b6dee5e76 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/action" status: 202 len: 0 microversion: 2.20 time: 0.575405 Oct 06 08:21:56.968504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 447/911] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Oct 6 08:21:56 2022] POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:21:56.978261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:56.978711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:56.985906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:56.986828 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:56.986828 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:56.987528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:56.987979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:56.988402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:57.130838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:57.139473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:57.140943 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:57.142125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6dcc447d-a96f-4f0c-b8c4-db909bd021fa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.169147 Oct 06 08:21:57.143300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 465/912] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:21:56 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:21:58.171832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:58.172582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:58.178901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:58.179413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:58.179851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:58.180537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:58.180990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:58.181412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:58.316286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:58.324349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:58.325842 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:58.327019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-82774e27-bbdd-4747-9986-f931d40f28cc tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.161062 Oct 06 08:21:58.327581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 448/913] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:21:58 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:21:59.353438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:21:59.354052 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:21:59.361538 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:59.362019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:59.362452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:59.363164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:21:59.363614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:21:59.364036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:21:59.495381 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:59.503815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:59.505252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:21:59.506439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3f43fa23-d394-481b-aa4a-94c917e6fd04 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.157295 Oct 06 08:21:59.507016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 466/914] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:21:59 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:00.487041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:00.487599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:00.493871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:00.494351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:00.494782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:00.495582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:00.496029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:00.496445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:00.519522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0c21f3f6-6498-4b23-8d3a-8ec1d7635db0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/ips" status: 200 len: 150 microversion: 2.1 time: 0.036409 Oct 06 08:22:00.520079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 449/915] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:22:00 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:00.532616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:00.533212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:00.540118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:00.540604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:00.541037 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:00.541808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:00.542174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:00.542591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:00.851362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:00.860882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:00.862622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:00.863956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-30118916-72c2-4645-b4d2-01c7bf3b0b42 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.335806 Oct 06 08:22:00.864516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 467/916] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:00 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:01.890752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:01.891392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:01.897791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:01.898279 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:01.898717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:01.899439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:01.899898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:01.900324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:02.027152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:02.036052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:02.037502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:02.038665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5dd23f59-0e33-4c80-a969-f15965041b34 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.152658 Oct 06 08:22:02.039265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 450/917] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:01 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:03.064061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:03.064704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:03.074115 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:03.076261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:03.076650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:03.079207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:03.079207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:03.079451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:03.180820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f2b4b1-3bf0-48b2-bbea-334cd1583568"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:03.183321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:03.189538 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:03.190026 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:03.190469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:03.191339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:03.191797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:03.192295 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:03.223890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:03.234959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:03.236543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:03.237733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-830bf6f1-a4d7-436b-b73e-910f350efe6b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.177613 Oct 06 08:22:03.238312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 468/918] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:03 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:04.013591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0218d639-ade3-4d44-896a-3631f9607018 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.835440 Oct 06 08:22:04.019844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 451/919] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:22:03 2022] POST /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments => generated 194 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:22:04.265261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:04.269700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:04.272665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:04.273163 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:04.273634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:04.274342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:04.274805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:04.275275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:04.410401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:04.418534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:04.420689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:04.421844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ec6d0c2f-50e5-4fe3-917f-047ba3cdea98 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.162312 Oct 06 08:22:04.422432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 469/920] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:04 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:05.449059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:05.449622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:05.457189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:05.457670 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:05.458102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:05.458786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:05.459262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:05.459682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:05.600882 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:05.609876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:05.611342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:05.612502 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9c87194c-8b46-4284-9951-24f0aa7d69a0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.168911 Oct 06 08:22:05.613056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 452/921] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:05 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:06.639475 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:06.640088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:06.646456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:06.647054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:06.647499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:06.648192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:06.648650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:06.649080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:06.777816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:06.786073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:06.787571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:06.788741 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a8c1f641-eb51-4604-b1b4-75aa97b4cb20 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.154089 Oct 06 08:22:06.789300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 470/922] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:06 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:07.813467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:07.814070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:07.820643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:07.821131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:07.821560 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:07.822271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:07.822719 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:07.823162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:07.955808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:07.963856 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:07.965294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:07.966450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1dba5709-d896-4e9b-ad28-2dca9227dda3 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.156893 Oct 06 08:22:07.967031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 453/923] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:07 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:08.992459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:08.993324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:09.000249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:09.000772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:09.001221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:09.001942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:09.002399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:09.002831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:09.134721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:09.145841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:09.145841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:09.146150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-614cbee0-f95e-4442-8f89-ac6aab1b413e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1744 microversion: 2.20 time: 0.157625 Oct 06 08:22:09.146621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 471/924] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:08 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:10.173209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:10.174539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:10.181179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:10.183209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:10.183209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:10.183209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:10.183209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:10.183623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:10.320672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:10.329354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:10.330798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:10.331996 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-521e385b-9443-4c22-b1ea-dab7ed011a62 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1744 microversion: 2.20 time: 0.163248 Oct 06 08:22:10.332588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 454/925] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:10 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:11.357625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:11.360207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:11.366373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:11.366851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:11.367310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:11.367999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:11.368452 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:11.368872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:11.521977 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:11.533527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:11.536003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:11.537454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c9072441-d6aa-4674-9849-daaaf4d071d9 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1744 microversion: 2.20 time: 0.183643 Oct 06 08:22:11.538292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 472/926] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:11 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:11.644581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "name": "network-vif-plugged", "status": "completed", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:11.654495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:11.655616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:11.656170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:11.666846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] Creating event network-vif-plugged:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:22:11.672140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-f8856813-2f1b-4552-bd61-feee52a25e72 req-3272cb0d-17ce-47fb-ae31-6b6520b91bbf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Oct 06 08:22:11.672742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 455/927] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:12.564643 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:12.565249 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:12.572555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.573044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.573476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.574168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.574616 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.575060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.620771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73f2b4b1-3bf0-48b2-bbea-334cd1583568"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:12.623278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:12.630061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.630543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.631000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.631694 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.632144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.632564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.715169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:12.723340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:12.724797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:12.725955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-22b183bf-8130-411f-acdb-2c8c67c46bf2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1744 microversion: 2.20 time: 0.165147 Oct 06 08:22:12.726499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 473/928] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:12 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:12.731753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: POST /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments HTTP/1.1 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 74 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:22:12.733484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {"volumeAttachment": {"volumeId": "73f2b4b1-3bf0-48b2-bbea-334cd1583568"}} Oct 06 08:22:12.735171 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'server_id': 'ddf52209-2aa9-40ad-8cf5-76c38ac74b41', 'body': {'volumeAttachment': {'volumeId': '73f2b4b1-3bf0-48b2-bbea-334cd1583568'}}} Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:12.739222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:12.740675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 400 to user: Invalid volume: volume 73f2b4b1-3bf0-48b2-bbea-334cd1583568 is already attached to instances: ddf52209-2aa9-40ad-8cf5-76c38ac74b41 {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0176c75f-aebe-424b-b63d-8eaf75b715a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118995 Oct 06 08:22:12.742228 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 456/929] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:22:12 2022] POST /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 06 08:22:12.804365 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:12.805066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:12.817027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.817027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.817027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.817027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:12.817375 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:12.817375 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:12.898305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'services' on Instance uuid ddf52209-2aa9-40ad-8cf5-76c38ac74b41 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:22:13.093149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f4c38903-b042-442f-b73d-b32af6a5fd93 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments/73f2b4b1-3bf0-48b2-bbea-334cd1583568" status: 202 len: 0 microversion: 2.1 time: 0.292520 Oct 06 08:22:13.093671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 474/930] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:22:12 2022] DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments/73f2b4b1-3bf0-48b2-bbea-334cd1583568 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:22:13.102084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:13.104338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:13.111071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:13.111555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:13.111984 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:13.112673 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:13.113118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:13.113539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:13.144794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3856672c-9e56-40ed-b7b7-778216169c84 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Oct 06 08:22:13.145351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 457/931] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:22:13 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:13.753010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:13.753837 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:13.760022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:13.760526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:13.760943 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:13.761630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:13.762082 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:13.762772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:13.913631 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:13.923109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:13.924571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:13.925950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e578a08e-d114-414d-8887-8c78abdb2dfb tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1744 microversion: 2.20 time: 0.177828 Oct 06 08:22:13.926604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 475/932] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:13 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:14.158160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:14.160389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:14.166831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:14.167354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:14.167796 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:14.168488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:14.168939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:14.169363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:14.200871 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4bb4c2f6-f757-4826-96ad-4a108ff372e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Oct 06 08:22:14.201429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 458/933] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:22:14 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:14.954487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:14.955134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:14.992415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:14.993058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:14.993509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:14.994489 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:14.994973 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:14.995557 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.142786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:15.156750 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:15.158749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:15.160367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-faadd4b7-2cf4-4689-90ee-a1fef12f3f2c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.210989 Oct 06 08:22:15.161085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 476/934] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:14 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:15.214045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:15.216090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:15.223122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.223956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.224626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.226059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.226588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.227227 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.262605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7e4f9c41-6768-477d-9d6d-d7f3cab9e247 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052394 Oct 06 08:22:15.263383 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 459/935] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:22:15 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 06 08:22:15.341726 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:15.342225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:15.349912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.350419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.350854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.351785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.352404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.352990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.386377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:22:15.667028 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-60f5d0aa-12a1-40e2-8c5d-37748a183252 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 204 len: 0 microversion: 2.1 time: 0.328781 Oct 06 08:22:15.667797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 477/936] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:22:15 2022] DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:22:15.680146 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:15.680769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:15.698185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.699331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.703810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.703810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:15.703810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:15.703810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:15.863654 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:15.871880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6e17314b-e162-46e3-98cc-9fc4fdb6f41e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.198801 Oct 06 08:22:15.883359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 460/937] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:15 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:16.188340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:16.189200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:16.196012 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:16.196586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:16.197104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:16.198564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:16.199147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:16.199645 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:16.220663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:16.350492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:16.362334 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:16.363937 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:16.365803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6db21ca7-8ae7-4499-a0a3-c7dfc49d4e88 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.181416 Oct 06 08:22:16.365803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 478/938] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:16 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:16.897409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:16.898712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:16.905445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:16.906793 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:16.907414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:16.908315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:16.908930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:16.909512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:16.914056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:17.056301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:17.065445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a9cf4110-dac3-4751-becd-5d7bd4d06a2c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.172035 Oct 06 08:22:17.066030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 461/939] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:16 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:17.392940 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:17.393683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:17.400620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:17.401116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:17.401555 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:17.402268 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:17.402723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:17.403187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:17.561632 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:17.572460 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:17.574000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:17.575740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c4589b99-9672-45f3-9383-3c6a7815f7ed tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.187686 Oct 06 08:22:17.576308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 479/940] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:17 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:18.091589 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:18.092518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:18.100369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:18.101133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:18.101612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:18.102375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:18.102843 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:18.103299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:18.252262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:18.262763 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-87dea536-9f42-4476-ae83-3d7915200fa9 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.177741 Oct 06 08:22:18.280506 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 462/941] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:18 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:18.606228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:18.610674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:18.620628 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:18.621458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:18.621956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:18.622719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:18.623304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:18.623811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:18.771313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:18.783471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:18.785480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:18.786779 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9f369b1f-f484-4bae-8eda-84ffd0a37087 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.184758 Oct 06 08:22:18.787385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 480/942] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:18 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:19.290663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:19.292360 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:19.300205 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:19.300963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:19.301622 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:19.302537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:19.303400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:19.303834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:19.460068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:19.482146 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-04f6fd0f-a2b9-4866-befc-c0c8c3d6f971 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.195852 Oct 06 08:22:19.489443 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 463/943] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:19 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:19.814627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:19.815962 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:19.825108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:19.829882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:19.830509 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:19.831486 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:19.831939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:19.832489 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:20.010698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:20.023902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:20.025036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:20.026618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7260bf62-4592-4d38-90b4-a1ac349cc23a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.216935 Oct 06 08:22:20.039894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 481/944] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:19 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:20.519154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:20.519758 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:20.526452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:20.526971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:20.527400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:20.528485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:20.528610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:20.528963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:20.662996 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:20.670725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d97271d0-b416-4ee8-afc2-09d243c98546 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.155575 Oct 06 08:22:20.671865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 464/945] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:20 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:21.060622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:21.061343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:21.072290 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:21.073422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:21.074127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:21.075351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:21.076288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:21.076789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:21.255925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:21.266065 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:21.268087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:21.269380 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-83f5e5bf-8dd5-4796-b6b6-02af06f59091 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.215291 Oct 06 08:22:21.272172 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 482/946] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:21 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:21.695787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:21.697715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:21.705206 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:21.705992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:21.706648 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:21.707666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:21.708414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:21.708878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:21.867585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:21.875908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-375380fc-d3db-4bf1-859e-cdf2a10349bf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.185669 Oct 06 08:22:21.891526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 465/947] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:21 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:22.296376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:22.297816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:22.304716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:22.309238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:22.309238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:22.309238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:22.309238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:22.309617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:22.463182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:22.472702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:22.474140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:22.475335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-735a86ba-0a63-439d-aafb-da7657faa126 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.183493 Oct 06 08:22:22.475899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 483/948] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:22 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:22.901358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:22.902625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:22.910264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:22.910757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:22.911283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:22.912347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:22.913022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:22.913679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:23.067304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:23.075594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-206f7463-dbe4-4a1a-86aa-d12ce4e582a5 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.178735 Oct 06 08:22:23.086987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 466/949] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:22 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:23.501561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:23.502158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:23.509456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:23.509961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:23.510403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:23.511158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:23.511625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:23.512052 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:23.651004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:23.661868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:23.663434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:23.664623 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6738d1fe-1e33-405c-a9f3-5f09b9666152 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.167064 Oct 06 08:22:23.665192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 484/950] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:23 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:24.097902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:24.098508 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:24.104973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:24.105456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:24.105887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:24.106569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:24.107046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:24.107465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:24.239816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:24.247765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7da224ad-6a15-46b1-8ba3-f45dfb5c0489 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.153754 Oct 06 08:22:24.248335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 467/951] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:24 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:24.691552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:24.692846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:24.699591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:24.700346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:24.701047 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:24.701993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:24.702930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:24.703666 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:25.209539 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:25.217912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:25.219457 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:25.220689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b1a966ed-0172-49e4-b781-18490080f1aa tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1739 microversion: 2.20 time: 0.534861 Oct 06 08:22:25.221367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 485/952] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:24 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1739 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:25.276242 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:25.277335 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:25.284617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:25.285296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:25.285726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:25.286580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:25.287220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:25.287645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:25.424277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:25.431995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-defc9c72-7a94-44d7-b8d8-65989bbcc089 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1682 microversion: 2.1 time: 0.159955 Oct 06 08:22:25.432555 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 468/953] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:25 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:25.789238 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf52209-2aa9-40ad-8cf5-76c38ac74b41", "name": "network-vif-deleted", "tag": "9f9ef7e0-f04d-4b74-b05b-a57559617076"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:25.800952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:25.801569 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:25.802252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:25.814625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] Creating event network-vif-deleted:9f9ef7e0-f04d-4b74-b05b-a57559617076 for instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 on hv-cinder-86021 Oct 06 08:22:25.820630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-b53df153-b6ac-4af7-8038-7ee62a5a5afb req-1f169163-1281-4213-9759-92217380e6de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Oct 06 08:22:25.821068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 486/954] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:26.247930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:26.248628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:26.255396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:26.255957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:26.256404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:26.259208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:26.259208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:26.259208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:26.402359 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:26.415539 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:26.419363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:26.419363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-533bacab-970d-4b39-be5d-a3cff1b0f846 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1721 microversion: 2.20 time: 0.174501 Oct 06 08:22:26.420134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 469/955] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:26 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:26.455883 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:26.456577 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:26.463149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:26.463829 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:26.464542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:26.465397 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:26.466003 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:26.466579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:26.504134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:26.504876 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:26.505682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:26.506282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid ddf52209-2aa9-40ad-8cf5-76c38ac74b41 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:22:26.560570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:26.573627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-406f15af-c8a5-4f77-90a4-990323d40dbf tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1331 microversion: 2.1 time: 0.121741 Oct 06 08:22:26.575136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 487/956] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:26 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:27.445710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:27.446337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:27.448690 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=47 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:27.454055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.454530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.455005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.455937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.456388 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.456808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.597167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:27.601854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:27.602417 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:27.609783 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.610404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.610974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.611089 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:27.611683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.612140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.612487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:27.612627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.613718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8e176c5f-f46c-4418-a673-4d41d022e48b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1721 microversion: 2.20 time: 0.171932 Oct 06 08:22:27.616836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 470/957] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:27 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:27.646638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.647227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.647675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.648128 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid ddf52209-2aa9-40ad-8cf5-76c38ac74b41 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:22:27.688590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:27.696401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-63cabc2b-0deb-4f08-b519-275510d409c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1331 microversion: 2.1 time: 0.102527 Oct 06 08:22:27.697168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 488/958] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:27 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:27.710718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "name": "network-vif-unplugged", "status": "completed", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:27.720409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:27.721094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:27.721587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:27.734093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] Creating event network-vif-unplugged:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:22:27.739264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-f80ce159-4c83-469d-b910-31c5ece879cc req-764d9522-0d6e-4247-b1fc-8ee5d0a3d03d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034821 Oct 06 08:22:27.739870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 471/959] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:28.640636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:28.641270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:28.647675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:28.649510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:28.649510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:28.649510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:28.649816 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:28.650243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:28.721514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:28.722215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:28.729063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:28.729563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:28.730288 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:28.731023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:28.731488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:28.731920 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:28.765093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:28.765677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:28.766105 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:28.766551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid ddf52209-2aa9-40ad-8cf5-76c38ac74b41 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:22:28.789969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:28.799392 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:28.800704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:28.802091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-53178eab-cf04-4d95-a214-e8bb16f3b98d tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1721 microversion: 2.20 time: 0.166132 Oct 06 08:22:28.802651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 489/960] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:28 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:28.814504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:28.822160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-67a0985b-a0d0-48d9-aef1-96fd4d82be7b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 200 len: 1331 microversion: 2.1 time: 0.106319 Oct 06 08:22:28.822807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 472/961] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:28 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:29.830241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:29.830854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:29.837363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:29.837847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:29.838338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:29.839054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:29.839513 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:29.840027 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:29.846593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:29.848768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:29.855602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:29.856091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:29.856527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:29.857229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:29.857682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:29.858102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:29.873543 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 HTTP/1.1 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:22:29.875667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:22:29.877386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'ddf52209-2aa9-40ad-8cf5-76c38ac74b41'} Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:22:29.878241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:22:29.879822 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:22:29.881712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:22:29.881712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dcf36812-b62e-486d-b69f-88e5dfb70bc4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 404 len: 111 microversion: 2.1 time: 0.035375 Oct 06 08:22:29.881712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 473/962] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:29 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:22:29.885926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8715ef3a-4758-4d56-9ccb-bb2bb0b9d826 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '.version_select at 0x7f9237ca9430>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:29.973876 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8715ef3a-4758-4d56-9ccb-bb2bb0b9d826 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409564153" status: 202 len: 0 microversion: 2.1 time: 0.091754 Oct 06 08:22:29.974655 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 474/963] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Oct 6 08:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409564153 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:22:29.985530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:29.993733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:29.995218 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:29.996420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-80dd98c1-cc5a-471a-942e-01e1c8a92537 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1664 microversion: 2.20 time: 0.170749 Oct 06 08:22:29.996995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 490/964] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:29 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:30.022243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04d1cc1b-46c6-465c-ad74-bcb6e6228377"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:30.024585 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:30.031813 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:30.032294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:30.032910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:30.033603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:30.034152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:30.034460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:30.719686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9a762273-10dd-453f-9d7d-5f5ca86105df tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: .version_select at 0x7f923f3a81f0>, body: {"keypair": {"name": "tempest-keypair-2085657926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL9GYw0M+IAcsTVFi5uTgBdQWscLffnqs2N+d3TdNkA2jZQg15rrS3y0VV9WoYne5psjfsRDB2yp+OnE9MmqUURa8Pz7E636XHpFIFee7HWROFbYmrKucSZyH6XUFbUHw=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:30.729730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:30.735798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-9a762273-10dd-453f-9d7d-5f5ca86105df tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:22:30.739644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-9a762273-10dd-453f-9d7d-5f5ca86105df tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:22:30.815972 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9a762273-10dd-453f-9d7d-5f5ca86105df tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100394 Oct 06 08:22:30.816535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 491/965] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:22:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:22:31.076432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-634149bf-ae2c-4f45-a12f-ee87a380b1f5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.058263 Oct 06 08:22:31.077396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 475/966] 10.222.0.30 () {62 vars in 1364 bytes} [Thu Oct 6 08:22:30 2022] POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments => generated 188 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 06 08:22:31.212465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:31.213058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:31.218805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:31.219431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:31.219876 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:31.220583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:31.221049 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:31.221472 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:31.859182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-39c3d8d2-565d-4bd9-9996-d1e2e4286e3b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments/04d1cc1b-46c6-465c-ad74-bcb6e6228377" status: 202 len: 0 microversion: 2.20 time: 0.651247 Oct 06 08:22:31.860447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 492/967] 10.222.0.30 () {60 vars in 1457 bytes} [Thu Oct 6 08:22:31 2022] DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments/04d1cc1b-46c6-465c-ad74-bcb6e6228377 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:22:31.925058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:31.925656 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:31.933446 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:31.933848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:31.934644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:31.935431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:31.936214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:31.936857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:31.999208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121076) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 08:22:32.129693 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:32.348056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-15a64be0-7890-4f8b-bbc3-8f6c9d3dfe3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/action" status: 202 len: 0 microversion: 2.20 time: 0.428354 Oct 06 08:22:32.348765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 476/968] 10.222.0.30 () {62 vars in 1319 bytes} [Thu Oct 6 08:22:31 2022] POST /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:22:32.357086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:32.358112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:32.366012 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:32.366532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:32.367087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:32.371599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:32.371599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:32.371599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:32.504655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:32.508372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:32.518152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:32.522545 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:32.522545 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4fab8b84-16f7-49c4-90ff-afab30c9d029 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1672 microversion: 2.20 time: 0.167832 Oct 06 08:22:32.528589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 493/969] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:32 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:33.165211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607526860", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "916cf03d-8c1b-4b3b-a1cf-702059cc42e1"}], "security_groups": [{"name": "tempest-securitygroup--975703150"}], "key_name": "tempest-keypair-2085657926", "user_data": "}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:33.277418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] validate_networks() for [('916cf03d-8c1b-4b3b-a1cf-702059cc42e1', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:22:33.548976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:33.549740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:33.557163 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:33.557733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:33.558239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:33.559173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:33.559781 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:33.560418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:33.707054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:33.715794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:33.717227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:33.718387 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-398df9a5-753f-46db-ab9a-6f8d00b72ae7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1672 microversion: 2.20 time: 0.174445 Oct 06 08:22:33.720705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 494/970] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:33 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1672 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:33.725576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:22:33.725992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:22:33.726458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:22:33.726877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:22:33.727293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:22:33.738572 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:33.739116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:33.739550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:33.740267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:33.740710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:33.741135 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:33.757373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:22:33.769153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Getting quotas for user 9932c7fb57394d709a27023f3ae2677e and project d6a6c776cba64be9a1710815c0b0f952. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:22:33.772172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:22:33.774465 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:22:33.907278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9bc0cf1c-8aeb-494a-ba3f-f80a30330cee tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.746007 Oct 06 08:22:33.907970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 477/971] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:22:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:22:33.919058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-df9b6655-fb1c-4162-94c7-31a0d415bc28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:33.919672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-df9b6655-fb1c-4162-94c7-31a0d415bc28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:33.974700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-df9b6655-fb1c-4162-94c7-31a0d415bc28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:33.981979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-df9b6655-fb1c-4162-94c7-31a0d415bc28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1242 microversion: 2.1 time: 0.066734 Oct 06 08:22:33.982559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 495/972] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:33 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:34.746258 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:34.747063 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:34.753751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:34.757697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:34.757697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:34.757697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:34.757697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:34.758074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:34.884612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:34.893125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:34.894568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:34.895757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-36952a73-65c5-4d8a-9be8-90507a7221e7 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1672 microversion: 2.20 time: 0.154002 Oct 06 08:22:34.896317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 478/973] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:34 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:35.005206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:35.006508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:35.013974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:35.014459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:35.014894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:35.015614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:35.016400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:35.016794 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:35.079672 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:35.087328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7535e413-48a4-4f47-a9d2-b9322aafc61c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1246 microversion: 2.1 time: 0.087003 Oct 06 08:22:35.087831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 496/974] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:34 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:35.924136 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:35.924865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:35.932112 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:35.932627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:35.933040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:35.933740 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:35.934197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:35.934624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:36.084809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:36.093394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:36.095255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:36.096610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-79472088-2a56-4b5e-a69b-5f68702b4bd2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1672 microversion: 2.20 time: 0.178867 Oct 06 08:22:36.097255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 479/975] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:35 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:36.112497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:36.113147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:36.119797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:36.120279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:36.120712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:36.121432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:36.121880 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:36.122299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:36.194300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:36.202180 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3dd2453d-bbcd-4645-aaaf-4d7b59804b86 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1246 microversion: 2.1 time: 0.093552 Oct 06 08:22:36.202768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 497/976] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:36 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:37.122170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:37.124369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:37.130526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:37.131163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:37.131681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:37.132770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:37.133330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:37.133848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:37.225140 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:37.226441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:37.242623 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:37.243463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:37.243912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:37.245189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:37.245765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:37.246866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:37.299475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:37.308053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:37.309682 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:37.311495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f136b6e6-04c6-4a5f-8e19-936cfe700a6e tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.193356 Oct 06 08:22:37.315309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 480/977] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:37 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:37.362902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:37.371276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-56c4cae3-8b6a-498e-b516-e865e90ba855 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1294 microversion: 2.1 time: 0.150122 Oct 06 08:22:37.371925 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 498/978] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:37 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1294 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:38.339579 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:38.340193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:38.348292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:38.349006 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:38.349536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:38.350143 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:38.350605 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:38.351057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:38.398675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:38.400008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:38.406528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:38.407045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:38.407652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:38.408543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:38.408998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:38.409422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:38.474296 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:38.482785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2baafb43-b0dc-4de3-8da7-90201871786a tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1312 microversion: 2.1 time: 0.091190 Oct 06 08:22:38.483646 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 499/979] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:38 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1312 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:38.492667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:38.502334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:38.503449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:38.504700 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0c77b187-df34-412f-b629-8daac4dd428a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.169886 Oct 06 08:22:38.505356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 481/980] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:38 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:39.510045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:39.511208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:39.526118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:39.526608 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:39.527075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:39.527788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:39.528240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:39.528703 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:39.540189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:39.543214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:39.557680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:39.558521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:39.567083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:39.567957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:39.568603 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:39.569085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:39.742521 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:39.758049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:39.761830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7127d7e2-0dd3-4a38-9bd8-87b644b9475d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.255541 Oct 06 08:22:39.762894 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 500/981] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:39 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:39.770900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:39.778550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:39.780152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-351461c4-a6e8-4726-977a-c16991c30871 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.250734 Oct 06 08:22:39.781011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 482/982] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:39 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:40.787385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:40.788105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:40.794689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:40.797649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:40.797649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:40.804374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:40.804955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:40.805474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:40.812499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:40.814422 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:40.822162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:40.826620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:40.826620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:40.826620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:40.826620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:40.827214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:41.008248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:41.016651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:41.019242 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:41.020429 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-77285d7d-e6b8-4595-a582-4b6ddfb97634 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.212469 Oct 06 08:22:41.021177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:41.025522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 483/983] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:40 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:41.031113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-955d3b2d-9b57-4f1c-918d-5554d71e4a28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.247487 Oct 06 08:22:41.038048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 501/984] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:40 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:42.052621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:42.053220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:42.060104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:42.061108 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:42.063549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:42.065356 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:42.066129 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:42.067115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:42.067808 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:42.068568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:42.070173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:42.070920 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:42.071609 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:42.073158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:42.073641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:42.074075 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:42.271970 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:42.277109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:42.279225 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:42.280869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:42.283768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6f3b5462-e5ba-423a-b37b-99e93d3d4f5c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.235454 Oct 06 08:22:42.285244 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 484/985] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:42 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:42.297617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-47819b0a-f359-48fb-9d6a-fb1171e5e502 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.243085 Oct 06 08:22:42.299734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 502/986] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:42 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:43.310626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:43.311377 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:43.321846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:43.323484 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:43.324153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:43.325251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:43.326180 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:43.326805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:43.328861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:43.330777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:43.336399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:43.337011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:43.337493 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:43.338266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:43.338818 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:43.339370 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:43.507399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:43.520637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d5f4a0b1-3b3b-4f98-8dad-f8ffeeea2721 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.195534 Oct 06 08:22:43.522059 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 503/987] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:43 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:43.533834 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:43.544967 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:43.547004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:43.549624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-43746a7f-2219-4246-98d1-3677189e26c2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.242504 Oct 06 08:22:43.559030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 485/988] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:43 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:44.547625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:44.549527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:44.552915 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=6 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:44.558344 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:44.558930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:44.559461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:44.560903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:44.561371 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:44.561801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:44.581483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:44.581483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:44.581483 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:44.582093 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=6 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:44.587990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:44.588618 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:44.589128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:44.589897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:44.590527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:44.591126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:44.759141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:44.768476 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a46d571a-3470-4e41-933d-78034e0b59dc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.224895 Oct 06 08:22:44.769678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 504/989] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:44 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:44.794264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:44.806166 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:44.808100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:44.816056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3a8abeb2-3619-4508-af70-12e6bbc584ce tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.235507 Oct 06 08:22:44.816056 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 486/990] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:44 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:45.799030 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:45.804709 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:45.810611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:45.811190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:45.811629 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:45.812503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:45.813123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:45.814583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:45.840499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:45.841733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:45.850393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:45.854250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:45.854879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:45.855801 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:45.859548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:45.860729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:46.010063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:46.020154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-24ff7aa8-9c58-445f-8c20-fe73b2b8e1c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.230255 Oct 06 08:22:46.021374 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 505/991] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:45 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:46.023849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:46.032867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:46.034775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:46.036308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d9a6c458-7f3e-4dd0-87b0-073d80826e07 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.200074 Oct 06 08:22:46.040911 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 487/992] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:45 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:47.044255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:47.047450 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:47.059351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:47.062147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:47.062795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:47.066860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:47.067568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:47.068288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:47.072043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:47.073564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:47.081456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:47.081975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:47.082410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:47.086677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:47.091496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:47.091985 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:47.268700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:47.277601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0a119cb0-6b1f-44aa-b580-b20f2530741d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.237249 Oct 06 08:22:47.278046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:47.280173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 506/993] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:47 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:47.293099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:47.294787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:47.295983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-42f9d020-6d98-46fb-9985-ad8532813172 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.228664 Oct 06 08:22:47.296551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 488/994] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:47 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:48.302671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:48.303252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:48.309630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:48.310106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:48.310544 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:48.311256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:48.311696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:48.312112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:48.324140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:48.324747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:48.334084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:48.334084 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:48.334321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:48.334831 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:48.335319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:48.335736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:48.446639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:48.455337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-88c6f894-f19c-4175-b8e9-a1da78caec03 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.156739 Oct 06 08:22:48.456002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 507/995] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:48 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:48.470247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:48.478645 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:48.480191 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:48.481348 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2bf36df2-8fa2-4a4c-beba-a184d928df44 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.161214 Oct 06 08:22:48.481907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 489/996] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:48 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:49.477706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:49.478261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:49.484867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:49.485830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:49.486278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:49.486998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:49.487458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:49.487886 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:49.507458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:49.508141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:49.514708 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:49.515231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:49.515671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:49.516957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:49.517416 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:49.517874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:49.620449 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:49.628852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2a0444d3-30e2-4520-a552-970dbdff3b28 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.155033 Oct 06 08:22:49.629732 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 508/997] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:49 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:49.652230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:49.661094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:49.662519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:49.663719 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-db4c3bc4-ef66-4935-bb22-f83a5cdaadb2 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.160488 Oct 06 08:22:49.664260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 490/998] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:49 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:49.774773 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1760842528", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "networks": [{"uuid": "53f96cd7-3c26-4ef5-affe-ad44bf54a2a3"}]}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:49.828669 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] validate_networks() for [('53f96cd7-3c26-4ef5-affe-ad44bf54a2a3', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:22:50.166045 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:22:50.166565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:22:50.167098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:22:50.167507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:22:50.167912 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:22:50.177354 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.177826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.178254 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.178993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.179443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.179859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.197508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Getting quotas for project f0458e73970e41b3ac7948f8eb8f75e9. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:22:50.203708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Getting quotas for user b6fd97062022478e9d34c318b309fd90 and project f0458e73970e41b3ac7948f8eb8f75e9. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:22:50.213522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:22:50.216142 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:22:50.370599 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a4cc8efd-b178-4527-9a22-04eb00231dc4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599583 Oct 06 08:22:50.371560 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 509/999] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 06 08:22:50.383704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c944f09a-edd2-4e82-a365-32b1fd18a2bf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:50.384592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c944f09a-edd2-4e82-a365-32b1fd18a2bf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:50.479956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c944f09a-edd2-4e82-a365-32b1fd18a2bf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:50.491594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c944f09a-edd2-4e82-a365-32b1fd18a2bf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1214 microversion: 2.1 time: 0.111602 Oct 06 08:22:50.492402 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 491/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:50 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:50.652551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:50.653274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:50.660264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.660759 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.661190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.661892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.662338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.662760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.690216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:50.691011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:50.698895 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.701771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.701771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.701771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:50.701771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:50.702148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:50.844391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:50.859139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:50.862027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:50.863841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-83f76c5e-755e-4878-ba4f-ea713cfb009b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.178282 Oct 06 08:22:50.864681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 492/1001] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:50 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:50.927664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:50.935345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-257973a2-c24e-493e-bacd-c10d9aced2f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.287200 Oct 06 08:22:50.935921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 510/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:50 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:51.477748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d296c18a-5cf7-478a-9c6a-76b0a08eff99", "tag": "c01f883a-2e96-4d1f-8ef8-6c67df007449"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:51.488050 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:51.497913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:51.497913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:51.499895 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] Creating event network-changed:c01f883a-2e96-4d1f-8ef8-6c67df007449 for instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 on hv-cinder-86021 Oct 06 08:22:51.505229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-51d0c0d3-8a90-4a18-8d30-3b18e881543c req-89abaf06-8e5e-4c5a-9231-4adc94ff53cb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Oct 06 08:22:51.505827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 493/1003] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:22:51.515311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dc3b1a0f-abbb-4bf2-b070-116c2e6b7d9e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:51.516012 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-dc3b1a0f-abbb-4bf2-b070-116c2e6b7d9e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:51.572004 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-dc3b1a0f-abbb-4bf2-b070-116c2e6b7d9e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:51.579454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-dc3b1a0f-abbb-4bf2-b070-116c2e6b7d9e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1214 microversion: 2.1 time: 0.067563 Oct 06 08:22:51.580158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 511/1004] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:51 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:51.897672 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:51.898371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:51.904681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:51.905172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:51.905610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:51.906300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:51.906756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:51.907213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:51.963710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:52.037285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:52.037285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:52.037285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:52.037285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:52.038323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:52.038323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:52.038323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:52.043710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:52.053941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:52.054898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:52.056190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-70ebe581-4c7e-4160-b2b1-4c743a37ff30 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.163728 Oct 06 08:22:52.056981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 494/1005] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:51 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:52.129422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:52.141437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4901a4e4-e44c-47d4-b42c-6131e7281f8e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.180107 Oct 06 08:22:52.141437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 512/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:51 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:52.605496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:52.605496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:52.609355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:52.609851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:52.610289 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:52.611002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:52.611462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:52.612456 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:52.616905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:52.673744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:52.682082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7dfccc44-bfe9-4368-a0dc-331d080a758d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1218 microversion: 2.1 time: 0.083415 Oct 06 08:22:52.682659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 495/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:52 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:53.083641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:53.085896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:53.092527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.093021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.094000 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.094467 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.094932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.095680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.100876 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:53.161908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:53.162601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:53.169814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.170382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.170813 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.171530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.171976 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.173266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.313509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:53.322300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f9a0112e-0380-4037-8f02-b53507f3f7c0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.164423 Oct 06 08:22:53.330713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 496/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:53 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:22:53.337340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:53.346597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:53.348345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:53.350015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae139741-05f8-4f67-9c2f-41b2b4a9bd95 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.272100 Oct 06 08:22:53.350583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 513/1009] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:53 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:53.705260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:53.706240 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:53.712376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.712862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.713293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.713981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:53.714430 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:53.714848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:53.779917 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:53.788368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-0fe9a4a8-1307-43d1-a357-1a3ff965d7b4 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1266 microversion: 2.1 time: 0.087316 Oct 06 08:22:53.793783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 497/1010] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:53 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:54.346104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:54.346714 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:54.352797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.353283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.353808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.354445 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.354899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.355366 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.377861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:54.379080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:54.385691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.386013 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.386460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.387182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.387631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.388312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.488575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:54.496141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-babf0a01-97d7-4fe5-9b82-13fe0125921c tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.154194 Oct 06 08:22:54.496711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 514/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:54 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:54.522773 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:54.530984 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:54.532447 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:54.533756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e9a9a2a8-4621-4eb1-b3cd-9820a716ecb5 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.160303 Oct 06 08:22:54.534733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 498/1012] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:54 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:54.812062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:54.812677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:54.819419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.819909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.820353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.821050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:54.821507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:54.821932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:54.883044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:54.890923 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-17f40ee8-4d88-4566-bccf-40701b94879d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1274 microversion: 2.1 time: 0.082828 Oct 06 08:22:54.891620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 515/1013] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:54 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:55.519922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:55.520517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:55.526926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.527439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.527877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.528565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.529022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.529450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.560078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:55.560685 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:55.567729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.568213 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.568652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.569341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.569785 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.570204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.657720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:55.666265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c1b93604-54d1-49bb-8cb2-55dfbe54e02b tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.150199 Oct 06 08:22:55.666846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 499/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:55 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:55.702207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:55.711641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:55.713071 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:55.714228 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5b5de78a-6552-46e2-a7c7-aac4dfa004da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.157987 Oct 06 08:22:55.714782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 516/1015] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:55 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:55.915251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:55.916448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:55.922730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.923743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.923873 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.925075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:55.925521 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:55.925941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:55.994017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:56.003118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a0953255-95dd-4933-a41e-43fd51d25523 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1274 microversion: 2.1 time: 0.091743 Oct 06 08:22:56.016207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 500/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:55 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:56.133507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "name": "network-vif-plugged", "status": "completed", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:56.143906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:56.147105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:56.147105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:56.156653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] Creating event network-vif-plugged:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:22:56.162432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-e5d0166e-0bab-4e58-ad68-16799e8ed8e3 req-c93ada10-dc3a-4a1e-863d-5720b71b7745 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Oct 06 08:22:56.163062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 517/1017] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:22:56.691276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:56.693139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:56.699487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:56.699978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:56.700398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:56.701256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:56.701712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:56.702134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:56.740344 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:56.742163 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:56.749866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:56.752846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:56.752846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:56.753291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:56.753956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:56.754735 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:56.839104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:56.847092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-164a7ac4-1503-4fb7-9232-474472d43129 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.160605 Oct 06 08:22:56.847677 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 501/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:56 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:56.908363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:56.916455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:56.917881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:56.919066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-68a8422f-bf2d-4383-8dfb-67ff4dd0131f tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.183346 Oct 06 08:22:56.919626 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 518/1019] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:56 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:57.025592 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:57.026115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:57.032009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.032487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.032917 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:57.033833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.034282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.034703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:57.161707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:57.169468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b9cda6a3-ebd9-445e-99c9-9edf99bbbb17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.147798 Oct 06 08:22:57.170024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 502/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:57 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:57.870501 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:57.871126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:57.877418 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.877901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.878331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:57.879042 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.879491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.879910 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:57.945460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:57.946119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:57.948565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:22:57.953720 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.954207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.954640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:57.955953 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:57.956400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:57.957033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:58.063306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:58.071868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a848abae-4402-40cb-b95e-8fb58e22f4e0 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.205123 Oct 06 08:22:58.073086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 519/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:57 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:58.105257 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:58.114624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:58.116199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:58.117392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a589af14-760b-42ee-b2aa-4a92d202f56a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.175946 Oct 06 08:22:58.118132 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 503/1022] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:57 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:22:58.118270 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae611672-5037-456d-a52a-b046856d0fde", "tag": "7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:22:58.130382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:58.130866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:58.131323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:58.159670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] Creating event network-changed:7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89 for instance ae611672-5037-456d-a52a-b046856d0fde on hv-cinder-86021 Oct 06 08:22:58.161179 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-7f0959ce-75d2-4b43-980c-3588297b8482 req-35faf9da-08ef-452e-9724-14a51964298d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046873 Oct 06 08:22:58.161806 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 520/1023] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:22:58.193649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:58.197190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:58.200695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:58.201195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:58.201636 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:58.202337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:58.202798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:58.203251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:58.332910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:58.340710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f57fed78-71dd-4150-a593-c7bfd686488a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.151726 Oct 06 08:22:58.341291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 504/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:58 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:59.096833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:59.104178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:59.104178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.104178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.105157 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.105683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.105916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.106348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.148195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:59.149130 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:59.156475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.157034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.157542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.158248 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.159365 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.159791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.260151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:59.268812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3587eb93-53c9-468f-9c3e-848103ecdd81 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.176702 Oct 06 08:22:59.269437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 521/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:59 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:22:59.310073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:59.318090 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:59.320382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:59.321637 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2a303650-5109-4652-a95f-5e42d907f89c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.177455 Oct 06 08:22:59.322227 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 505/1026] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:22:59 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:22:59.365792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:22:59.365792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:22:59.370482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.371068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.371514 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.372187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:22:59.372634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:22:59.373061 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:22:59.505516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:22:59.513823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-73c00aba-dec7-4f31-a7b0-472321b83d88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.153987 Oct 06 08:22:59.514903 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 522/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:22:59 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:00.233255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d296c18a-5cf7-478a-9c6a-76b0a08eff99", "name": "network-vif-plugged", "status": "completed", "tag": "c01f883a-2e96-4d1f-8ef8-6c67df007449"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:00.244115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.244595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.245068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.256832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] Creating event network-vif-plugged:c01f883a-2e96-4d1f-8ef8-6c67df007449 for instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 on hv-cinder-86021 Oct 06 08:23:00.262058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-9360c281-5c76-4abd-8d12-c7fd03793fed req-fe468988-3b7f-4c31-93eb-958a52cb406e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032513 Oct 06 08:23:00.262690 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 506/1028] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:00.291279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:00.291895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:00.294293 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:00.300030 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.300515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.300952 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.301636 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.302088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.302515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.348924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:00.349530 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:00.355678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.356190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.356626 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.357312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.357766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.358237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.441964 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:00.449730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1842c9f3-ec52-4293-855d-4537a2b550f4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.162529 Oct 06 08:23:00.450313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 523/1029] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:00 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:00.487563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:00.493290 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:00.501256 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:00.502716 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:00.503890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ef2e18a6-ff24-4164-a3b3-46051a5c17af tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.159959 Oct 06 08:23:00.504478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 507/1030] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:23:00 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:23:00.538587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:00.539239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:00.545066 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.545542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.548394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.548394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:00.548394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:00.548394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:00.674416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:00.681899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1f1473e5-f75a-4c50-ae46-a3cc6d9a2501 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.147198 Oct 06 08:23:00.682464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 524/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:00 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:01.473668 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:01.474273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:01.480748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.481229 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.481660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.482350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.482795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.483243 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.529724 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:01.530340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:01.532695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:01.542540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.543285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.543718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.544614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.545064 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.545659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.578798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=8 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:01.628017 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:01.635965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-84e5aa2e-2a43-42b6-8a6b-d4f788184eb4 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.166523 Oct 06 08:23:01.636633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 508/1032] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:01 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:01.704807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:01.705552 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:01.722500 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.723034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.723487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.724199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:01.724659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:01.725085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:01.777001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:01.788325 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:01.789905 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:01.791243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4c1d8819-13a4-47c6-9c51-4dee3a3cb70a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1730 microversion: 2.20 time: 0.265416 Oct 06 08:23:01.791901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 525/1033] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:23:01 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 06 08:23:01.873363 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:01.882060 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e58c25db-b7f6-44bd-a2e3-5dd0d5259b3e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.181190 Oct 06 08:23:01.882709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 509/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:01 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:23:02.659844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:02.660411 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:02.667436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.667918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.668389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.669078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.669529 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.669955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.800336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:02.808184 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-72871e77-1912-4a5e-83e1-6f92cdd2754e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1367 microversion: 2.1 time: 0.152638 Oct 06 08:23:02.808777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 526/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:02 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:02.829771 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:02.836022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:02.841188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.841699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.842134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.842809 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.843312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.843785 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.906458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:02.907232 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:02.913650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.914077 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.914516 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.915252 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:02.915711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:02.916136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:02.976144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:02.984287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:02.985743 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:02.986923 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-238d7b93-58d8-465b-bca9-76ff4c6eee3c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1717 microversion: 2.20 time: 0.161197 Oct 06 08:23:02.987748 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 510/1036] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:23:02 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1717 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:23:03.044098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:03.051777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8bc2cfd6-c86f-4091-bc56-34f13c7cbd60 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.149677 Oct 06 08:23:03.052340 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 527/1037] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:02 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:23:03.831468 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:03.832082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:03.838870 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:03.839391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:03.839832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:03.840526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:03.840981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:03.841436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:03.978685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:03.988536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-32412f2d-4d85-4285-8c59-76667a20394e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1558 microversion: 2.1 time: 0.161154 Oct 06 08:23:03.989329 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 511/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:03 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:04.011068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:04.011604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:04.019002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:04.019002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:04.019227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:04.019706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:04.020154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:04.020638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:04.080394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:04.080394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:04.085224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:04.085723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:04.086222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:04.087000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:04.087541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:04.087966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:04.102524 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-39a70b58-76ac-401e-a28e-2868c38c3859 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095519 Oct 06 08:23:04.103285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 528/1039] 10.222.0.30 () {58 vars in 1275 bytes} [Thu Oct 6 08:23:04 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:04.107488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=100 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:04.238754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:04.247227 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6b56c2ad-e577-488c-b2c0-539fc3d7e2c6 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.173195 Oct 06 08:23:04.250421 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 512/1040] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:04 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:04.274125 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae611672-5037-456d-a52a-b046856d0fde", "name": "network-vif-plugged", "status": "completed", "tag": "7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:04.285116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:04.285705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:04.286199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:04.299506 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] Creating event network-vif-plugged:7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89 for instance ae611672-5037-456d-a52a-b046856d0fde on hv-cinder-86021 Oct 06 08:23:04.304699 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-5611955f-19cd-48b4-b302-05ee4abc23c7 req-708fa390-28b9-49de-9270-758e5c3a8e0a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Oct 06 08:23:04.305399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 529/1041] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:05.270873 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:05.271639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:05.278283 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:05.278836 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:05.279301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:05.279987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:05.280434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:05.280854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:05.414854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:05.423612 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7bf230b4-13f4-4ebc-af94-f411de2e9e17 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.157451 Oct 06 08:23:05.428024 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 513/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:05 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:05.432416 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d296c18a-5cf7-478a-9c6a-76b0a08eff99", "tag": "c01f883a-2e96-4d1f-8ef8-6c67df007449"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:05.442772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:05.443284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:05.443716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:05.454474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] Creating event network-changed:c01f883a-2e96-4d1f-8ef8-6c67df007449 for instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 on hv-cinder-86021 Oct 06 08:23:05.459730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-08434056-8e27-449c-93b2-e41c5573614c req-cb9a932e-d4ea-461a-a1ec-9385fd051e1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031925 Oct 06 08:23:05.460348 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 530/1043] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:06.445860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:06.447152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:06.453434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:06.463095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:06.463095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:06.463095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:06.463095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:06.463490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:06.594148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:06.602485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-26d42820-2962-4f52-9ae6-dea9ed1d2534 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1314 microversion: 2.1 time: 0.160580 Oct 06 08:23:06.606108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 514/1044] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:06 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:07.626563 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:07.627867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:07.633916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:07.634389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:07.634851 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:07.635549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:07.636005 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:07.636421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:07.763505 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:07.771327 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e29a42c8-fc1d-4afa-b656-686313d0aecf tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1499 microversion: 2.1 time: 0.149411 Oct 06 08:23:07.772116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 531/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:07 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1499 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:08.667581 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:08.668100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:08.675674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:08.676158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:08.676590 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:08.677276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:08.677728 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:08.678150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:08.703057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:23:09.001909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e3420c57-386a-43ae-8fb3-e66dcdcdf04a tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 204 len: 0 microversion: 2.1 time: 0.337795 Oct 06 08:23:09.002583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 515/1046] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:23:08 2022] DELETE /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:23:09.011047 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:09.011665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:09.018775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:09.019291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:09.019728 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:09.020415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:09.020870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:09.021295 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:09.152595 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:09.155018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=100 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:09.161789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0a7648c4-a253-4977-9688-2050a2ab9c88 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1505 microversion: 2.1 time: 0.154586 Oct 06 08:23:09.168832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 532/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:09 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:10.185613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:10.187028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:10.193609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:10.194092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:10.194546 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:10.195252 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:10.195704 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:10.199937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:10.329293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:10.337635 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9ee98fc3-5660-4609-a5f2-e4be047c3539 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1505 microversion: 2.1 time: 0.156266 Oct 06 08:23:10.338198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 516/1048] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:10 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:11.232145 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:11.232695 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:11.240493 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:11.240980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:11.241426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:11.242118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:11.242604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:11.243060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:11.267601 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-31cea11d-8cf2-4606-ae72-60419f626cc8 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/ips" status: 200 len: 145 microversion: 2.1 time: 0.039632 Oct 06 08:23:11.275664 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 533/1049] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:23:11 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:11.362160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:11.363188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:11.369374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:11.370185 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:11.370701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:11.371623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:11.372082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:11.372507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:11.437666 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:11.449428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-52ed1bef-8cd8-4baa-9d3f-1a3d4865d93b tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1463 microversion: 2.1 time: 0.091636 Oct 06 08:23:11.450504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 517/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:11 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:11.498582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae611672-5037-456d-a52a-b046856d0fde", "name": "network-vif-deleted", "tag": "7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:11.508708 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:11.509280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:11.509706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:11.521801 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] Creating event network-vif-deleted:7f3bd01b-d9f2-49b3-bfeb-c1dd38fddf89 for instance ae611672-5037-456d-a52a-b046856d0fde on hv-cinder-86021 Oct 06 08:23:11.526874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-764b81aa-1bdc-4cb1-b173-8c65fc9e86e3 req-bb77197b-5cd4-4ac5-bdc1-617068ca67ad service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 Oct 06 08:23:11.527939 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 534/1051] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:12.474018 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:12.474621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:12.480795 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:12.481276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:12.484752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:12.484752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:12.484752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:12.484752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:12.516608 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:12.517097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:12.565111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:12.565111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lazy-loading 'fault' on Instance uuid ae611672-5037-456d-a52a-b046856d0fde {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:23:12.565111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:12.568044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-62278197-2f6c-489e-bf50-4cedead0819f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 200 len: 1304 microversion: 2.1 time: 0.098411 Oct 06 08:23:12.568618 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 518/1052] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:12 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:13.592181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:13.592875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: ae611672-5037-456d-a52a-b046856d0fde] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:13.599765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:13.600244 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:13.600673 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:13.601351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:13.601797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:13.602219 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:13.615761 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] HTTP exception thrown: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Request method failure captured: Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde HTTP/1.1 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpBWaUApPZwJVX-BrLpqR5_hkr3faJR6EUJh_iG0sWj6UvxILoTi4jepZrjoblmXNpyU9YTW6JjR8kV_jGspWW6ra5kn-VQjfJcNahMbTDI0wiozZbzjQ9PMmS9xnKpfXAq4tRS_4gO6CKBqt3puMB4UzeRkfrubkITjH4jeuahKr1o Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: f0458e73970e41b3ac7948f8eb8f75e9 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:23:13.617360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: f0458e73970e41b3ac7948f8eb8f75e9 Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesActionsTest-1905608812-project Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: b6fd97062022478e9d34c318b309fd90 Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesActionsTest-1905608812-project Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. Oct 06 08:23:13.619120 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'ae611672-5037-456d-a52a-b046856d0fde'} Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:13.620126 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. Oct 06 08:23:13.621660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:13.622992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Returning 404 to user: Instance ae611672-5037-456d-a52a-b046856d0fde could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:13.622992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2ec6dabc-1df6-45a1-a695-c5738a780815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde" status: 404 len: 111 microversion: 2.1 time: 0.030778 Oct 06 08:23:13.622992 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 535/1053] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:13 2022] GET /compute/v2.1/servers/ae611672-5037-456d-a52a-b046856d0fde => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:13.668908 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714287937", "imageRef": "f565ee6c-fa81-4a69-9e29-abb67098fc51", "flavorRef": "452", "networks": [{"uuid": "53f96cd7-3c26-4ef5-affe-ad44bf54a2a3"}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:13.722715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] validate_networks() for [('53f96cd7-3c26-4ef5-affe-ad44bf54a2a3', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:23:13.944464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c7dcc91-61b6-445d-bd3d-2c0fe934178b"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:13.947187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:13.953564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:13.954153 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:13.954667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:13.955579 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:13.955954 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:13.956386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:14.302511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:23:14.303037 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:23:14.303570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:23:14.304007 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:23:14.304481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:23:14.313391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:14.313865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:14.314294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:14.315573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:14.316030 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:14.316459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:14.333588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Getting quotas for project f0458e73970e41b3ac7948f8eb8f75e9. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:23:14.337620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Getting quotas for user b6fd97062022478e9d34c318b309fd90 and project f0458e73970e41b3ac7948f8eb8f75e9. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:23:14.349948 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:23:14.352269 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f565ee6c-fa81-4a69-9e29-abb67098fc51',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:23:14.495678 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cea2cdcb-96ba-4c58-9f3d-a44891ee369e tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830493 Oct 06 08:23:14.496364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 519/1054] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:23:14.508023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-29ac7963-0ab4-4528-947b-c3fbe89f30c5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:14.508574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-29ac7963-0ab4-4528-947b-c3fbe89f30c5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:14.561315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-29ac7963-0ab4-4528-947b-c3fbe89f30c5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:14.570216 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-29ac7963-0ab4-4528-947b-c3fbe89f30c5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1214 microversion: 2.1 time: 0.065331 Oct 06 08:23:14.571486 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 520/1055] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:14 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:14.766196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f592f8b8-3f5e-40e5-b82c-b39f69a3f952 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825519 Oct 06 08:23:14.766764 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 536/1056] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:23:13 2022] POST /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:23:15.593732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:15.594334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:15.601769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:15.602250 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:15.602705 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:15.603513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:15.604013 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:15.604434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:15.669404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:15.678224 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8c66de7c-99db-49c4-a8c2-8b8581cdacc1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1218 microversion: 2.1 time: 0.088395 Oct 06 08:23:15.678798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 521/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:15 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:16.702807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:16.703535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:16.710630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:16.711152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:16.711587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:16.712283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:16.712731 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:16.713152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:16.812492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:16.820707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-db65abf7-d990-4e0b-bb4b-6f5856ee64aa tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1274 microversion: 2.1 time: 0.122806 Oct 06 08:23:16.821282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 537/1058] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:16 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:17.844102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:17.844715 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:17.851961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:17.852569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:17.853062 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:17.853797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:17.854249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:17.854667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:17.993462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:18.001703 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5159e39c-2af0-4591-991e-97a8c13e1a0d tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.161391 Oct 06 08:23:18.002728 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 522/1059] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:17 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:18.340136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bcf8b78-fc52-4480-a5f5-68ba17cf7e63", "tag": "d285f2d8-2fcd-4469-9694-642802545639"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:18.356091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:18.356559 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:18.356983 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:18.368312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] Creating event network-changed:d285f2d8-2fcd-4469-9694-642802545639 for instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 on hv-cinder-86021 Oct 06 08:23:18.373050 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-8fb828e6-3ef6-45e2-9aa3-9a5dd21bd508 req-7207ba3b-a72c-4b1c-9b56-6190a89b6080 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Oct 06 08:23:18.373841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 538/1060] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:19.039071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:19.039071 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:19.045542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:19.046023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:19.046449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:19.047165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:19.047613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:19.048028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:19.181684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:19.189305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-70eb1df2-2dc8-4b0d-9806-1e3d6d6dc81f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.155651 Oct 06 08:23:19.189874 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 523/1061] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:19 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:20.214424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:20.215148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:20.222138 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:20.222677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:20.223144 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:20.223841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:20.224294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:20.224719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:20.357860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:20.366313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3add50c6-3df4-4159-aa7e-e5bfe66cc425 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.156539 Oct 06 08:23:20.366901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 539/1062] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:20 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:21.390233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:21.390862 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:21.397918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:21.398394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:21.398828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:21.399536 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:21.399981 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:21.400396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:21.532124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:21.540445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-319ec465-93b3-4fa9-9a1d-1e22cc74b152 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.154534 Oct 06 08:23:21.541433 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 524/1063] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:21 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:22.563838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:22.564517 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:22.571206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:22.571630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:22.572063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:22.572750 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:22.573198 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:22.573619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:22.700568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:22.709811 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e944d03d-ebef-4a23-b28e-40840828dd47 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.149849 Oct 06 08:23:22.710388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 540/1064] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:22 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:23.429957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:23.433721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:23.438737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.439249 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.439684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.440369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.440857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.441276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.470303 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8ec173b7-62a7-4e4b-98b3-9caab06736d0 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Oct 06 08:23:23.470859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 525/1065] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:23:23 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:23.482231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:23.482739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:23.488891 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.489386 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.489872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.490562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.491053 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.491485 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.521907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cd342c5c-94d9-4ccc-ba60-2ec82d47de44 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b" status: 200 len: 194 microversion: 2.1 time: 0.043726 Oct 06 08:23:23.522649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 541/1066] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Oct 6 08:23:23 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:23.733413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:23.734095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:23.740046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.740586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.741035 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.741724 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:23.742183 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:23.742610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:23.877987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:23.886169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-cd2717eb-2bab-4e49-af46-6b897c012fc5 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.156770 Oct 06 08:23:23.886729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 526/1067] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:23 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:24.405464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcf8b78-fc52-4480-a5f5-68ba17cf7e63", "name": "network-vif-plugged", "status": "completed", "tag": "d285f2d8-2fcd-4469-9694-642802545639"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:24.416688 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:24.417159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:24.417584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:24.429575 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] Creating event network-vif-plugged:d285f2d8-2fcd-4469-9694-642802545639 for instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 on hv-cinder-86021 Oct 06 08:23:24.435320 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-2994ebcd-27f7-4d31-8155-4946c5233798 req-3c1cd0fb-8118-4f7d-b653-be35a8a97e75 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033085 Oct 06 08:23:24.435896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 542/1068] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:24.909692 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:24.910355 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:24.912324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:24.913454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=8 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:24.918091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:24.918564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:24.919020 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:24.919755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:24.920207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:24.920623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:25.056889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:25.064554 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4d6676e1-594b-45d1-8a17-a0baf8a0656f tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.158837 Oct 06 08:23:25.065134 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 527/1069] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:24 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:25.138800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5633c72c-cb9c-471e-95f4-2254f2719492"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:25.141368 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:25.147694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:25.148189 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:25.148622 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:25.149311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:25.149760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:25.150180 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:26.088574 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:26.089213 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:26.095617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:26.096099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:26.096535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:26.098002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:26.098182 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:26.098638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:26.294866 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:26.298240 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:26.303370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b24c3e2b-357a-45a9-ae07-029c9dcc75ce tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1314 microversion: 2.1 time: 0.218648 Oct 06 08:23:26.303956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 528/1070] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:26 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:23:26.569552 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-829fbe40-08bb-4dab-8a9b-de279d8a9055 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "POST /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.435154 Oct 06 08:23:26.570339 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 543/1071] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:23:25 2022] POST /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 194 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:27.326679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:27.327305 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:27.335092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:27.335569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:27.336000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:27.336718 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:27.337165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:27.337619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:27.467334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:27.475828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5382a555-eb27-4e59-8600-3c910ec27815 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1498 microversion: 2.1 time: 0.153066 Oct 06 08:23:27.476399 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 529/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:27 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:28.594395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:28.594988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:28.601853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:28.602329 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:28.602757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:28.603464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:28.603913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:28.604333 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:28.631044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:23:28.898930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-60a1f2cf-0aa6-49af-a5de-b4b6bf1df9ec tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 204 len: 0 microversion: 2.1 time: 0.308785 Oct 06 08:23:28.899477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 544/1073] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:23:28 2022] DELETE /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:23:28.907627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:28.908241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:28.915190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:28.915675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:28.916124 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:28.916787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:28.917240 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:28.917662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:29.051114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:29.059762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bc39b8c5-9116-44a4-ab9c-a941605af809 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1504 microversion: 2.1 time: 0.156053 Oct 06 08:23:29.060331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 530/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:28 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:30.083242 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:30.083934 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:30.090160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:30.090639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:30.091105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:30.091786 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:30.092240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:30.092657 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:30.222206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:30.231777 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f94caf7e-fde1-4f35-97a1-cbe9af18b3b1 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1504 microversion: 2.1 time: 0.152709 Oct 06 08:23:30.239662 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 545/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:30 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:31.046082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bcf8b78-fc52-4480-a5f5-68ba17cf7e63", "name": "network-vif-deleted", "tag": "d285f2d8-2fcd-4469-9694-642802545639"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:31.051633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:31.056697 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:31.057164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:31.057586 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:31.068593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] Creating event network-vif-deleted:d285f2d8-2fcd-4469-9694-642802545639 for instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 on hv-cinder-86021 Oct 06 08:23:31.074247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-d9c09847-ce48-44c6-86fb-c4e7911d14ae req-322a2081-2a90-4422-ab3f-a6ff27ecaa48 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031845 Oct 06 08:23:31.074877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 531/1076] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:31.265634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:31.266245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:31.272743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:31.273226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:31.273661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:31.274345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:31.274799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:31.275257 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:31.337482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6fd97062022478e9d34c318b309fd90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0458e73970e41b3ac7948f8eb8f75e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:31.345221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a8915820-7d52-4be9-b409-ed731a8e4d94 tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 200 len: 1299 microversion: 2.1 time: 0.083740 Oct 06 08:23:31.345890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 546/1077] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:31 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:23:32.370733 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:32.371475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] [instance: 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:32.378770 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:32.379278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:32.379774 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:32.380451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:32.380897 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:32.381315 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:32.395520 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] HTTP exception thrown: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Request method failure captured: Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 HTTP/1.1 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpBWaUApPZwJVX-BrLpqR5_hkr3faJR6EUJh_iG0sWj6UvxILoTi4jepZrjoblmXNpyU9YTW6JjR8kV_jGspWW6ra5kn-VQjfJcNahMbTDI0wiozZbzjQ9PMmS9xnKpfXAq4tRS_4gO6CKBqt3puMB4UzeRkfrubkITjH4jeuahKr1o Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: f0458e73970e41b3ac7948f8eb8f75e9 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:23:32.397164 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f0458e73970e41b3ac7948f8eb8f75e9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: f0458e73970e41b3ac7948f8eb8f75e9 Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesActionsTest-1905608812 Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesActionsTest-1905608812-project Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: b6fd97062022478e9d34c318b309fd90 Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesActionsTest-1905608812-project Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. Oct 06 08:23:32.398827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '3bcf8b78-fc52-4480-a5f5-68ba17cf7e63'} Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:32.399878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. Oct 06 08:23:32.401438 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:32.402877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] Returning 404 to user: Instance 3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:32.402877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-32bc845e-ea8e-43e5-a854-33f7f708b8ef tempest-VolumesActionsTest-1905608812 tempest-VolumesActionsTest-1905608812-project] 10.222.0.30 "GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63" status: 404 len: 111 microversion: 2.1 time: 0.032032 Oct 06 08:23:32.402877 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 532/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:32 2022] GET /compute/v2.1/servers/3bcf8b78-fc52-4480-a5f5-68ba17cf7e63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:38.672750 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:38.675029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:38.678209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:38.683100 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.689793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.689793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.689793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.689793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.690396 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.715832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c2b01e6c-5aa0-4c8d-a995-4d813d32f013 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046959 Oct 06 08:23:38.716388 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 547/1079] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:23:38 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:38.854297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:38.854839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:38.861940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.862425 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.862863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.864236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.865202 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.865638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.897382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1ae618bd-2b66-4b6b-aefd-1c26e99aecba tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b" status: 200 len: 194 microversion: 2.1 time: 0.046925 Oct 06 08:23:38.897865 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 533/1080] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Oct 6 08:23:38 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:38.908429 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:38.908932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:38.916193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.916746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.917192 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.917887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:38.918341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:38.918765 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:38.922043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:23:39.002749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lazy-loading 'services' on Instance uuid ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:23:39.172693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b0b8b90b-6b95-46d0-9ec5-a0c304e33ade tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b" status: 202 len: 0 microversion: 2.1 time: 0.268158 Oct 06 08:23:39.173281 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 548/1081] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:23:38 2022] DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/7c7dcc91-61b6-445d-bd3d-2c0fe934178b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:23:41.422085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:41.423211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:41.436043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:41.436978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:41.437548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:41.438163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:41.438813 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:41.439328 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:41.475934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-49b92ba6-c661-484a-b9c6-764466af25e5 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/5633c72c-cb9c-471e-95f4-2254f2719492" status: 200 len: 194 microversion: 2.1 time: 0.058267 Oct 06 08:23:41.476914 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 534/1082] 10.222.0.30 () {58 vars in 1413 bytes} [Thu Oct 6 08:23:41 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/5633c72c-cb9c-471e-95f4-2254f2719492 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:23:41.487853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:41.489888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:41.497831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:41.498668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:41.499225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:41.500431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:41.500884 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:41.501304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:41.612414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lazy-loading 'services' on Instance uuid ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:23:41.839023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-175dff66-8a66-49cb-9460-1c2fd55ed8fc tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/5633c72c-cb9c-471e-95f4-2254f2719492" status: 202 len: 0 microversion: 2.1 time: 0.355382 Oct 06 08:23:41.840166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 549/1083] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:23:41 2022] DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments/5633c72c-cb9c-471e-95f4-2254f2719492 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:23:44.211681 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:44.213995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:44.222533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.223939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.224488 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.225268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.225965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.226482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.267683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-19413a99-4cbd-4602-b026-b65e79dacebb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060214 Oct 06 08:23:44.268674 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 535/1084] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:23:44 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:23:44.407414 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:44.411025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:44.418318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.419078 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.419694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.420573 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.421199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.421792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.458161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d03bddd5-9018-4451-bca9-acf8be1a8f0e tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055150 Oct 06 08:23:44.464866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 550/1085] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:23:44 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:23:44.533278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:44.533918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:44.541287 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.541767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.542371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.543264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.543890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.544467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.574404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:23:44.870492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-86746e91-e682-45d1-a67f-0e5697f1e3cf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 204 len: 0 microversion: 2.1 time: 0.341236 Oct 06 08:23:44.871660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 536/1086] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:23:44 2022] DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:23:44.882756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:44.883589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:44.890771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.892342 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.893241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:44.894152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:44.894848 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:44.895542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:45.074363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:45.088383 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-8cbdb98d-7823-4c2c-be97-3c8908bbeeaf tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1671 microversion: 2.1 time: 0.209590 Oct 06 08:23:45.088543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 551/1087] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:44 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:46.113179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:46.113788 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:46.124553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:46.125052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:46.125503 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:46.126222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:46.126676 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:46.127144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:46.314114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:46.324497 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ee7a51f2-d16b-4aef-8607-ca121f727e75 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1671 microversion: 2.1 time: 0.215856 Oct 06 08:23:46.327342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 537/1088] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:46 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1671 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:47.350408 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:47.351199 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:47.362583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:47.363158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:47.364330 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:47.365036 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:47.365494 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:47.365916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:47.622980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:47.635216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1f813f3f-8881-4a83-bf73-6a3472e4d96a tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1671 microversion: 2.1 time: 0.288981 Oct 06 08:23:47.641624 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 552/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:47 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1671 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:48.667391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:48.668318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:48.674568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:48.675146 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:48.675589 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:48.677945 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:48.678168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:48.678664 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:48.713795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be", "name": "network-vif-deleted", "tag": "0d871f00-3696-4ce9-9f48-5d50bb9856a4"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:23:48.736395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:48.736395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:48.737866 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:48.756308 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] Creating event network-vif-deleted:0d871f00-3696-4ce9-9f48-5d50bb9856a4 for instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be on hv-cinder-86021 Oct 06 08:23:48.761896 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-c735f63f-1b32-4294-81c0-a32125fe8132 req-a7e57307-ac0c-4ede-923c-67f7532bb366 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051683 Oct 06 08:23:48.817813 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 553/1090] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:23:48.818302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:48.818302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bb21c21d-492a-4d37-8984-37876ad12cdb tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1604 microversion: 2.1 time: 0.121416 Oct 06 08:23:48.818302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 538/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:48 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:49.813950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:49.814671 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:49.822856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:49.823683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:49.824323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:49.825195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:49.825815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:49.826420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:49.875984 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:49.876484 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:49.876921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:49.877377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lazy-loading 'fault' on Instance uuid ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:23:49.950580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb73bbd331754280a2a0cd64290ec3c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73f960dc36054e9ba7003628a82b7039', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:23:49.968438 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c7d1f45c-7436-49e6-8ec7-015c3c68044c tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 200 len: 1326 microversion: 2.1 time: 0.160492 Oct 06 08:23:49.969207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 554/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:49 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:23:50.994428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:50.995937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:51.003068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:51.004396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:51.005769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:51.006732 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:51.007498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:51.008115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:51.028392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be HTTP/1.1 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:23:51.030207 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:51.037292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be'} Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:51.038599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:51.042131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:51.044624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:51.044624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-700a00bf-da21-44bb-840a-c3103b525faa tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 404 len: 111 microversion: 2.1 time: 0.042445 Oct 06 08:23:51.044624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 539/1093] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:50 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:51.052969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6220163d-7b94-436a-a15b-fa4255f821b3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '.version_select at 0x7f923bce5af0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:51.133711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6220163d-7b94-436a-a15b-fa4255f821b3 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297271825" status: 202 len: 0 microversion: 2.1 time: 0.086304 Oct 06 08:23:51.134297 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 555/1094] 10.222.0.30 () {58 vars in 1218 bytes} [Thu Oct 6 08:23:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297271825 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:23:54.821455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:54.822803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:54.829918 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:54.830414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:54.830852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:54.831617 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:54.832158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:54.832889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:54.848418 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be HTTP/1.1 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:23:54.849951 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.852392 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be'} Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:54.853336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.855411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.856936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:54.856936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-17635f5c-cc42-41f9-9eaa-835ec17a866f tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 404 len: 111 microversion: 2.1 time: 0.038187 Oct 06 08:23:54.856936 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 540/1095] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:23:54 2022] DELETE /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:54.862288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:54.863844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:54.872684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:54.873297 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:54.873858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:54.874805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:54.875384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:54.875812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:54.891922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be HTTP/1.1 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:23:54.893637 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.895817 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be'} Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:54.896574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. Oct 06 08:23:54.898461 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:54.899902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:54.899902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c30fe1dd-6fc8-4e45-8097-82f274e09ce6 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be" status: 404 len: 111 microversion: 2.1 time: 0.038146 Oct 06 08:23:54.899902 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 556/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:54 2022] GET /compute/v2.1/servers/ac69ab42-cb0c-4c21-bddf-da0e5e8ec3be => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:56.413440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:56.414046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:56.421366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:56.421843 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:56.422280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:56.423189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:56.423647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:56.424076 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:56.438889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 HTTP/1.1 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:23:56.440482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.442769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'a957af7c-67a0-48fd-9982-e38551889d44'} Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:56.444137 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.447375 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.448963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:56.448963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dcd3e2aa-b3ef-4a3e-8967-ab4b5a2e7ce4 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 404 len: 111 microversion: 2.1 time: 0.033147 Oct 06 08:23:56.448963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 541/1097] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:23:56 2022] DELETE /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:23:56.450822 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:23:56.451463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] [instance: a957af7c-67a0-48fd-9982-e38551889d44] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:23:56.462924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:56.462924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:56.462924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:56.462924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:23:56.463504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:23:56.463504 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:23:56.481968 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] HTTP exception thrown: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Request method failure captured: Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 HTTP/1.1 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4yN5v0eGxW9POtPFP1UnrjU79VtSoZk37gCkqh3nJA2Hc2VekDn3SlYB0fjs5hHr-I7i4l_1sG4AVE4BWVm1VZwgedVLaEowr0tsfHJePKzpsvkWendxF4wdtKKgcHV6cXifgKUhuAJJYKzdA6F0JOhhbH4Hu-0jLCMq3qLrXz0zg Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:23:56.483568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_73f960dc36054e9ba7003628a82b7039"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/73f960dc36054e9ba7003628a82b7039"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 73f960dc36054e9ba7003628a82b7039 Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1910205170 Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: cb73bbd331754280a2a0cd64290ec3c8 Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeTestJSON-1910205170-project Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.485214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'a957af7c-67a0-48fd-9982-e38551889d44'} Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:23:56.486102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. Oct 06 08:23:56.487399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:23:56.489625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] Returning 404 to user: Instance a957af7c-67a0-48fd-9982-e38551889d44 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:23:56.489625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3ecd1fda-e3f7-42ef-83b3-7879372c03d1 tempest-AttachVolumeTestJSON-1910205170 tempest-AttachVolumeTestJSON-1910205170-project] 10.222.0.30 "GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44" status: 404 len: 111 microversion: 2.1 time: 0.038683 Oct 06 08:23:56.489625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 557/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:23:56 2022] GET /compute/v2.1/servers/a957af7c-67a0-48fd-9982-e38551889d44 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:24:10.281097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:10.283343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:10.288059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:10.288812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:10.293987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.294482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.294987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.295632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.296091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.296512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.336107 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b62d857a-a097-4e53-bd9f-c261798147da tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059209 Oct 06 08:24:10.336900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 542/1099] 10.222.0.30 () {60 vars in 1343 bytes} [Thu Oct 6 08:24:10 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:24:10.404915 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:10.405409 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:10.407944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:10.408577 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:10.413302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.413774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.414204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.414917 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.415372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.415790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.440960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:24:10.695162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d4f10e39-eaaa-4776-89cd-ce33ceed1c84 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 204 len: 0 microversion: 2.20 time: 0.290833 Oct 06 08:24:10.696512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 558/1100] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Oct 6 08:24:10 2022] DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 08:24:10.715041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:10.716286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:10.736573 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.737741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.739073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.740756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:10.741789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:10.742768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:10.919708 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:10.931379 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:10.933133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:10.934902 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f1fbec26-ad36-4560-9553-3805ed9e3ed0 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.231805 Oct 06 08:24:10.941031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 543/1101] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:10 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:24:11.961805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:11.962512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:11.969428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:11.969916 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:11.970358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:11.971077 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:11.971536 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:11.971963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:12.112259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:12.120107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:12.121792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:12.123092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-52eb2f7b-a595-4c3a-bba4-5a54828e1f0a tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1723 microversion: 2.20 time: 0.166780 Oct 06 08:24:12.128415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 559/1102] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:11 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:24:13.169150 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:13.169818 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:13.178391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:13.180378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:13.180378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:13.180378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:13.180651 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:13.181083 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:13.242818 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8211c04-50e4-43b1-9090-3d373f94a3c7", "name": "network-vif-deleted", "tag": "eb97d339-5183-43c5-b541-8b2a7595b71c"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:13.252862 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:13.253343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:13.253996 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:13.260241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:13.266655 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] Creating event network-vif-deleted:eb97d339-5183-43c5-b541-8b2a7595b71c for instance f8211c04-50e4-43b1-9090-3d373f94a3c7 on hv-cinder-86021 Oct 06 08:24:13.271831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-f1b8ab5d-df87-4a30-b6c1-90dcdbad8541 req-b16753cb-1994-4d0e-9ea0-5adb6fb8b7e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Oct 06 08:24:13.272752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 560/1103] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:13.276485 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:13.278741 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:13.280491 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-44e61769-921a-4689-bd59-23b4961f9471 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1656 microversion: 2.20 time: 0.119664 Oct 06 08:24:13.281085 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 544/1104] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:13 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:24:14.308309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:14.309113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:14.315316 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:14.315887 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:14.316389 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:14.317169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:14.317686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:14.318177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:14.352772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:14.353289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:14.353727 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:14.354179 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lazy-loading 'fault' on Instance uuid f8211c04-50e4-43b1-9090-3d373f94a3c7 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:24:14.402525 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:14.412136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:14.413597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36b26040882a4e85b82b40a3c17d33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95f59687b3b24c7f9095bcb5fb909a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:14.414756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-74b98e83-f4bf-4bd5-a397-0591419a14bf tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 200 len: 1372 microversion: 2.20 time: 0.111286 Oct 06 08:24:14.427044 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 561/1105] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:14 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 06 08:24:15.440729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:15.441343 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:15.448816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:15.449304 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:15.449742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:15.450434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:15.450890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:15.451339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:15.464781 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 HTTP/1.1 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:15.466319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:15.467823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'f8211c04-50e4-43b1-9090-3d373f94a3c7'} Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:15.468632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:15.470386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:15.471526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:15.471526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-263329e5-a562-4626-b55d-390f1bfaa890 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 404 len: 111 microversion: 2.20 time: 0.030922 Oct 06 08:24:15.471526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 545/1106] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:15 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:15.477760 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e5b11511-8a5b-4722-ac68-de48f6b05c1b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '.version_select at 0x7f923bd181f0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:15.562436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e5b11511-8a5b-4722-ac68-de48f6b05c1b tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693713352" status: 204 len: 0 microversion: 2.20 time: 0.089175 Oct 06 08:24:15.563051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 562/1107] 10.222.0.30 () {60 vars in 1262 bytes} [Thu Oct 6 08:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693713352 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 06 08:24:17.737141 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:17.737646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:17.744173 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:17.744656 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:17.745112 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:17.745803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:17.746253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:17.746713 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:17.760725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 HTTP/1.1 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:17.762309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.764314 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'f8211c04-50e4-43b1-9090-3d373f94a3c7'} Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:17.765115 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.766526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.767880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:17.767880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-36fe79af-a2f4-449d-bc4e-b57e0086638c tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 404 len: 111 microversion: 2.20 time: 0.030658 Oct 06 08:24:17.767880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 546/1108] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Oct 6 08:24:17 2022] DELETE /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:17.774007 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:17.774678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: f8211c04-50e4-43b1-9090-3d373f94a3c7] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:17.781323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:17.781795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:17.782220 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:17.782901 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:17.783408 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:17.783827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:17.797280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 HTTP/1.1 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:24:17.798930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.809653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'f8211c04-50e4-43b1-9090-3d373f94a3c7'} Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:17.811361 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. Oct 06 08:24:17.813106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:17.816068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance f8211c04-50e4-43b1-9090-3d373f94a3c7 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:17.816068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1355cd8a-ec8e-4dff-96c9-2e21e739e236 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7" status: 404 len: 111 microversion: 2.20 time: 0.031576 Oct 06 08:24:17.816068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 563/1109] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:17 2022] GET /compute/v2.1/servers/f8211c04-50e4-43b1-9090-3d373f94a3c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:19.119737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:19.120789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:19.127041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:19.127529 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:19.127958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:19.128641 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:19.129088 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:19.129507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:19.143568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a HTTP/1.1 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:19.145145 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.147709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a'} Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:19.148630 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.150156 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.157476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:19.157476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-49312ac9-7558-4b21-9668-87e6e32d14db tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 404 len: 111 microversion: 2.20 time: 0.031154 Oct 06 08:24:19.157476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 547/1110] 10.222.0.30 () {60 vars in 1280 bytes} [Thu Oct 6 08:24:19 2022] DELETE /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:19.157725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:19.157725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] [instance: aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:19.165119 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:19.165663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:19.166095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:19.172187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:19.172187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:19.172187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:19.182245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] HTTP exception thrown: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Request method failure captured: Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a HTTP/1.1 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo4xNXqoRrzO3lB4nr8nq9CGn2jR0XNFi8J69g8MG44LakT4puWWBflh2DkloVk1ZafaZEQGC-YsDp-k0gg_0JPaWmtuT_XExOCE1YEsKhfBgsbYvj3eAUghZADyUciTkTBQueP8TjbumeF7kUEl3RehDk6d4UfdKSKqcxF-GfNHRhc Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Openstack-Nova-Api-Version: 2.20 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:24:19.183812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/95f59687b3b24c7f9095bcb5fb909a67"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 95f59687b3b24c7f9095bcb5fb909a67 Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-318547413 Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 36b26040882a4e85b82b40a3c17d33bb Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeShelveTestJSON-318547413-project Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.185384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a'} Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:19.186226 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. Oct 06 08:24:19.187606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:19.188717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] Returning 404 to user: Instance aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:19.188717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d01ca69f-7ce2-4e97-a2dd-e9ba739888b6 tempest-AttachVolumeShelveTestJSON-318547413 tempest-AttachVolumeShelveTestJSON-318547413-project] 10.222.0.30 "GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a" status: 404 len: 111 microversion: 2.20 time: 0.033222 Oct 06 08:24:19.188717 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 564/1111] 10.222.0.30 () {60 vars in 1277 bytes} [Thu Oct 6 08:24:19 2022] GET /compute/v2.1/servers/aa15c1ef-4aa1-4d8e-b685-1da1ab4b8f6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:25.357011 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7187a5b0-9af3-4b00-96e4-f26c2c938c22 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Action: 'create', calling method: .version_select at 0x7f9237e9a820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-251686914", "metadata": {"Type": "work"}}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7187a5b0-9af3-4b00-96e4-f26c2c938c22 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 121 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:25.385662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-251686914", "metadata": {"Type": "work"}}} Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: Oct 06 08:24:25.387452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-251686914', 'metadata': {'Type': 'work'}}}} Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise error Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi '#$%' Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.388609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 08:24:25.391094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 08:24:25.392564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 06 08:24:25.392564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.392564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7187a5b0-9af3-4b00-96e4-f26c2c938c22 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.392564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7187a5b0-9af3-4b00-96e4-f26c2c938c22 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.147499 Oct 06 08:24:25.392564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 548/1112] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Oct 6 08:24:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:25.397922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-239b40f5-f734-4344-a14c-c3ce54db812c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Action: 'create', calling method: .version_select at 0x7f923f419160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1529929598", "metadata": {"Type": "work"}}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-239b40f5-f734-4344-a14c-c3ce54db812c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 120 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:24:25.402508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1529929598", "metadata": {"Type": "work"}}} Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:24:25.404177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1529929598', 'metadata': {'Type': 'work'}}}} Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise error Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi '0' Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.405310 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 08:24:25.407046 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 08:24:25.408483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 06 08:24:25.408483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.408483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-239b40f5-f734-4344-a14c-c3ce54db812c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.408483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-239b40f5-f734-4344-a14c-c3ce54db812c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010573 Oct 06 08:24:25.408483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 565/1113] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Oct 6 08:24:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:25.413362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-160203d5-0507-4410-a9d6-123540eef91c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Action: 'create', calling method: .version_select at 0x7f9237af31f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-238641848", "metadata": {"Type": "work"}}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-160203d5-0507-4410-a9d6-123540eef91c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 118 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:25.418004 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-238641848", "metadata": {"Type": "work"}}} Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: Oct 06 08:24:25.422663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-238641848', 'metadata': {'Type': 'work'}}}} Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise error Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi '' Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.423550 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 06 08:24:25.425126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 06 08:24:25.426462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 06 08:24:25.426462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.426462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-160203d5-0507-4410-a9d6-123540eef91c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.426462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-160203d5-0507-4410-a9d6-123540eef91c tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010001 Oct 06 08:24:25.426462 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 549/1114] 10.222.0.30 () {60 vars in 1156 bytes} [Thu Oct 6 08:24:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 06 08:24:25.428935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dcae62f1-bcda-4e48-946d-9c8bdcd9969a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Calling method '.version_select at 0x7f923f31eaf0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:25.459478 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-dcae62f1-bcda-4e48-946d-9c8bdcd9969a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] HTTP exception thrown: Volume tempest-invalid-384055611 could not be found. Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dcae62f1-bcda-4e48-946d-9c8bdcd9969a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-384055611 HTTP/1.1 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:24:25.461433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Volume tempest-invalid-384055611 could not be found. Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'tempest-invalid-384055611'} Oct 06 08:24:25.463029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-384055611 could not be found. (HTTP 404) (Request-ID: req-4fcd37f7-c244-427a-9a1f-db402b87ddfd) Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.463942 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:24:25.465149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-384055611 could not be found. Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:25.466288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-384055611 could not be found. Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-384055611 could not be found. Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dcae62f1-bcda-4e48-946d-9c8bdcd9969a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 404 to user: Volume tempest-invalid-384055611 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-dcae62f1-bcda-4e48-946d-9c8bdcd9969a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-384055611" status: 404 len: 98 microversion: 2.1 time: 0.038009 Oct 06 08:24:25.473640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 566/1115] 10.222.0.30 () {58 vars in 1215 bytes} [Thu Oct 6 08:24:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-384055611 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 06 08:24:25.474849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-63d8db6a-53c3-4113-ace1-800849e6f65a tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003855 Oct 06 08:24:25.474849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 550/1116] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Oct 6 08:24:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 06 08:24:25.482206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b3bcabb0-856b-4ac4-a046-8684ec407ad3 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003813 Oct 06 08:24:25.482700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 567/1117] 10.222.0.30 () {58 vars in 1137 bytes} [Thu Oct 6 08:24:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 06 08:24:25.491567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4aad5897-e375-4fac-b99b-66d4cffb5939 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Calling method '.version_select at 0x7f9237cbf550>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:25.520122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-4aad5897-e375-4fac-b99b-66d4cffb5939 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] HTTP exception thrown: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4aad5897-e375-4fac-b99b-66d4cffb5939 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/os-volumes/73ab5c21-74ff-4195-99f3-e983dd797197 HTTP/1.1 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:25.524179 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '73ab5c21-74ff-4195-99f3-e983dd797197'} Oct 06 08:24:25.525776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. (HTTP 404) (Request-ID: req-4db8376e-a1d6-4d84-ac11-c63d6105e682) Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.526784 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:24:25.527991 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 08:24:25.529125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4aad5897-e375-4fac-b99b-66d4cffb5939 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 404 to user: Volume 73ab5c21-74ff-4195-99f3-e983dd797197 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4aad5897-e375-4fac-b99b-66d4cffb5939 tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/73ab5c21-74ff-4195-99f3-e983dd797197" status: 404 len: 109 microversion: 2.1 time: 0.037992 Oct 06 08:24:25.530373 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 551/1118] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:24:25 2022] DELETE /compute/v2.1/os-volumes/73ab5c21-74ff-4195-99f3-e983dd797197 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:24:25.535684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cd4b8ee6-cd8a-431b-831d-501be5a7d67e tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Calling method '.version_select at 0x7f923f2eb4c0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:25.563889 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-cd4b8ee6-cd8a-431b-831d-501be5a7d67e tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] HTTP exception thrown: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cd4b8ee6-cd8a-431b-831d-501be5a7d67e tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Request method failure captured: Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/os-volumes/0788dca3-aeda-4c87-85fe-8527f7dcc988 HTTP/1.1 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpC597cxr9Oc_Z0alljXJje4c1asv4Vpm0930M9Q2ndhJT8Qfh6Y9_muJv8w_Is5Lf2OgIEhhIsAUSgyGYyMNQV7N5vTw0ui0bFbG7uvNjsO4OhK9v5S_xNmZwAI4alDbJ_ztIwDExOjagyIT7wXmGMoVAby3zUdp4VQScXpPbkk9hU Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:24:25.565808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3aad9591668d4fff82de33af929f4927"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3aad9591668d4fff82de33af929f4927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3aad9591668d4fff82de33af929f4927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 3aad9591668d4fff82de33af929f4927 Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesNegativeTest-1344973817 Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: fbe5787703ba486f9f0ac7a299484c4e Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesNegativeTest-1344973817-project Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '0788dca3-aeda-4c87-85fe-8527f7dcc988'} Oct 06 08:24:25.567961 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. (HTTP 404) (Request-ID: req-927dfc75-d0b7-4486-a065-430e668595fc) Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.569684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:24:25.571085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 08:24:25.572412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-cd4b8ee6-cd8a-431b-831d-501be5a7d67e tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] Returning 404 to user: Volume 0788dca3-aeda-4c87-85fe-8527f7dcc988 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-cd4b8ee6-cd8a-431b-831d-501be5a7d67e tempest-VolumesNegativeTest-1344973817 tempest-VolumesNegativeTest-1344973817-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0788dca3-aeda-4c87-85fe-8527f7dcc988" status: 404 len: 109 microversion: 2.1 time: 0.035431 Oct 06 08:24:25.573787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 568/1119] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:24:25 2022] GET /compute/v2.1/os-volumes/0788dca3-aeda-4c87-85fe-8527f7dcc988 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:24:35.119411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=12 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:35.120253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=24 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:35.124209 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:35.124827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:35.131197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:35.134350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:35.134350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:35.134350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:35.134350 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:35.134791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:35.158301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ab3a4056-559e-4af7-bfa1-7c300864db90 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/ips" status: 200 len: 151 microversion: 2.1 time: 0.041785 Oct 06 08:24:35.158872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 552/1120] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:24:35 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:39.030693 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:39.031491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:39.036311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb7e6912-89d9-439c-80a6-671854c3b049"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:39.040001 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:39.047098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:39.047587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:39.048294 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:39.048821 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:39.049152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:39.049608 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:40.045274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e4f2b7f6-3176-4c96-a207-75a51f5420f2 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "POST /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016184 Oct 06 08:24:40.046088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 569/1121] 10.222.0.30 () {60 vars in 1323 bytes} [Thu Oct 6 08:24:39 2022] POST /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:49.075767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:49.076259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:49.084451 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:49.088078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:49.088078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:49.088078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:49.088078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:49.088534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:49.180260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'services' on Instance uuid d296c18a-5cf7-478a-9c6a-76b0a08eff99 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:24:49.401323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a3053d5c-2247-4ebb-a68f-6a7fd2132263 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments/cb7e6912-89d9-439c-80a6-671854c3b049" status: 202 len: 0 microversion: 2.1 time: 0.331178 Oct 06 08:24:49.401853 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 553/1122] 10.222.0.30 () {58 vars in 1416 bytes} [Thu Oct 6 08:24:49 2022] DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments/cb7e6912-89d9-439c-80a6-671854c3b049 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:24:49.408107 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:24:49.413364 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:49.415772 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:49.422285 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:49.422990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:49.423428 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:49.424123 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:49.424578 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:49.425026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:49.460956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7b08cca9-ad8d-482f-b9db-53713abf09d8 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054440 Oct 06 08:24:49.461543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 570/1123] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:24:49 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:50.475147 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:50.477346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:50.483400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:50.483879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:50.484413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:50.485100 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:50.485549 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:50.485969 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:50.517845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-822dda3f-ba62-480c-a021-0cad3fe1beff tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047549 Oct 06 08:24:50.519767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 554/1124] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:24:50 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:51.531833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:51.533995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:51.540350 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:51.540825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:51.544446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:51.544446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:51.544446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:51.544446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:51.572663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7168b847-51ad-4679-8473-fe40b06639b1 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045190 Oct 06 08:24:51.573158 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 571/1125] 10.222.0.30 () {58 vars in 1302 bytes} [Thu Oct 6 08:24:51 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 06 08:24:51.864202 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:51.864714 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:51.870688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:51.871280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:51.871711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:51.872396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:51.872848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:51.873271 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:51.902041 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:24:52.229260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a57a0b54-a92a-4d29-b582-e12aecd7ab41 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 204 len: 0 microversion: 2.1 time: 0.592601 Oct 06 08:24:52.229853 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 555/1126] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:24:51 2022] DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:24:52.244870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:52.245480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:52.252980 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:52.253470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:52.254446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:52.256948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:52.257460 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:52.258092 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:52.443960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:52.451776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b56bb0bd-d1be-4659-bdc4-fe996d2b1a51 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1683 microversion: 2.1 time: 0.211303 Oct 06 08:24:52.452352 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 572/1127] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:24:52 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1683 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:24:53.477317 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:53.478051 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:53.485477 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:53.485963 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:53.486380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:53.487091 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:53.487654 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:53.488070 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:53.626158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:53.634889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-00c76fd2-3a79-4ce1-8523-6ba352b8116e tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1683 microversion: 2.1 time: 0.162679 Oct 06 08:24:53.635474 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 556/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:24:53 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:24:54.658301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:54.658932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:54.666843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:54.667384 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:54.672576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:54.672576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:54.672576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:54.672576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:55.092141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:55.101293 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9132b4ea-02e4-45d6-bda4-bc7b7d51d4c6 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1683 microversion: 2.1 time: 0.447305 Oct 06 08:24:55.101899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 573/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:24:54 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1683 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:24:55.759598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d296c18a-5cf7-478a-9c6a-76b0a08eff99", "name": "network-vif-deleted", "tag": "c01f883a-2e96-4d1f-8ef8-6c67df007449"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:24:55.771214 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:55.772036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:55.772582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:55.786431 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] Creating event network-vif-deleted:c01f883a-2e96-4d1f-8ef8-6c67df007449 for instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 on hv-cinder-86021 Oct 06 08:24:55.796823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-29a11b0e-81fe-48c5-912b-3aab93ebbac8 req-7d91b16e-743b-4a59-9f18-606a4f8c22e5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194907 Oct 06 08:24:55.802005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 557/1130] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:24:56.125981 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:56.126615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:56.133487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:56.133988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:56.134427 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:56.135212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:56.136208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:56.137098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:56.176069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:56.176550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:56.176987 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:56.177828 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lazy-loading 'fault' on Instance uuid d296c18a-5cf7-478a-9c6a-76b0a08eff99 {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:24:56.234906 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9932c7fb57394d709a27023f3ae2677e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a6c776cba64be9a1710815c0b0f952', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:24:56.244400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-09244c12-981a-489c-b74a-5f17238831ca tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 200 len: 1332 microversion: 2.1 time: 0.122498 Oct 06 08:24:56.245730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 574/1131] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:24:56 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:24:57.271541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:57.272524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:24:57.280118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:57.280602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:57.281034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:57.281730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:24:57.282202 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:24:57.282593 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:24:57.301726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 HTTP/1.1 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:24:57.304038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:24:57.305904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'd296c18a-5cf7-478a-9c6a-76b0a08eff99'} Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:24:57.310312 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:24:57.311950 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:24:57.313364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:24:57.313364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b18125f-cdd1-4a94-9491-c4f7de0062cc tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 404 len: 111 microversion: 2.1 time: 0.039964 Oct 06 08:24:57.313364 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 558/1132] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:24:57 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:24:57.314963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-653e08d4-3c96-4f75-977d-4e9b2e0a4196 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '.version_select at 0x7f923bceb3a0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:24:57.425243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-653e08d4-3c96-4f75-977d-4e9b2e0a4196 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085657926" status: 202 len: 0 microversion: 2.1 time: 0.114428 Oct 06 08:24:57.425875 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 575/1133] 10.222.0.30 () {58 vars in 1221 bytes} [Thu Oct 6 08:24:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2085657926 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:25:02.851537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:02.851914 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:02.858973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:02.859474 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:02.859909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:02.861014 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:02.861685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:02.862107 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:02.878642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 HTTP/1.1 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:02.880297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.882012 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'd296c18a-5cf7-478a-9c6a-76b0a08eff99'} Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:02.882924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.884702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.886762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:02.886762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c1511beb-e1be-4c08-8e21-5beaaa685b4d tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 404 len: 111 microversion: 2.1 time: 0.036830 Oct 06 08:25:02.886762 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 559/1134] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:25:02 2022] DELETE /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:02.891614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:02.900580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: d296c18a-5cf7-478a-9c6a-76b0a08eff99] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:02.900580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:02.900580 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:02.901091 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:02.901787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:02.902237 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:02.902658 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:02.916742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 HTTP/1.1 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:02.918415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.920060 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'd296c18a-5cf7-478a-9c6a-76b0a08eff99'} Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:02.924278 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. Oct 06 08:25:02.925836 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:02.927758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance d296c18a-5cf7-478a-9c6a-76b0a08eff99 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:02.927758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-304e7699-42f1-438c-88bb-40acb0d4b338 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99" status: 404 len: 111 microversion: 2.1 time: 0.032510 Oct 06 08:25:02.927758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 576/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:25:02 2022] GET /compute/v2.1/servers/d296c18a-5cf7-478a-9c6a-76b0a08eff99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 06 08:25:04.389966 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:04.390455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:04.398007 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.404110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.404110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.404110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.404110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.404493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.414192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 HTTP/1.1 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:04.415832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.417481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'ddf52209-2aa9-40ad-8cf5-76c38ac74b41'} Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:04.418400 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.419982 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.421598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:04.421598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4de5cc70-3bda-48ac-bfbe-693fe524f250 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 404 len: 111 microversion: 2.1 time: 0.031375 Oct 06 08:25:04.421598 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 560/1136] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:25:04 2022] DELETE /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:04.425651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:04.426264 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: ddf52209-2aa9-40ad-8cf5-76c38ac74b41] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:04.433328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.433802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.434231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.434911 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.435439 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.435861 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.449670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 HTTP/1.1 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:04.451214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.452845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'ddf52209-2aa9-40ad-8cf5-76c38ac74b41'} Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:04.453776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. Oct 06 08:25:04.455286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.456706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance ddf52209-2aa9-40ad-8cf5-76c38ac74b41 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:04.456706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-77e34a80-82fd-43f1-95a8-c176cc9e39ea tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41" status: 404 len: 111 microversion: 2.1 time: 0.030751 Oct 06 08:25:04.456706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 577/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:25:04 2022] GET /compute/v2.1/servers/ddf52209-2aa9-40ad-8cf5-76c38ac74b41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:04.461989 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:04.462526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:04.468671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.469148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.476475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.476475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.476475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.476475 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.487595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad HTTP/1.1 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:04.489154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.491709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '2eb0dfcf-fa42-40d8-b33c-b143432d90ad'} Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:04.493260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.494764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.496327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:04.496327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-124da3cb-be24-4b65-8fbb-edaf10d36878 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 404 len: 111 microversion: 2.1 time: 0.033840 Oct 06 08:25:04.496327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 561/1138] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:25:04 2022] DELETE /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:04.500758 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:04.501530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: 2eb0dfcf-fa42-40d8-b33c-b143432d90ad] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:04.509933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.510661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.511367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.512351 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:04.512883 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:04.513328 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:04.530456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad HTTP/1.1 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:04.532009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.533620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '2eb0dfcf-fa42-40d8-b33c-b143432d90ad'} Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:04.534527 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. Oct 06 08:25:04.536016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:04.537950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance 2eb0dfcf-fa42-40d8-b33c-b143432d90ad could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:04.537950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7f7c1d9c-dedf-45b5-acbd-b598ac9226ac tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad" status: 404 len: 111 microversion: 2.1 time: 0.036679 Oct 06 08:25:04.537950 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 578/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:25:04 2022] GET /compute/v2.1/servers/2eb0dfcf-fa42-40d8-b33c-b143432d90ad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:14.251534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:14.252054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:14.258643 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:14.259157 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:14.259590 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:14.260276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:14.260731 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:14.261152 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:14.275998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe HTTP/1.1 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:14.278052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.279611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'f517d63c-e311-4c11-98b1-48e50f55b6fe'} Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:14.281331 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.284218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.287567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:14.287567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-95af87a4-cc9e-46a4-b86f-bbe5c6dcb496 tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 404 len: 111 microversion: 2.1 time: 0.031342 Oct 06 08:25:14.287567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 562/1140] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:25:14 2022] DELETE /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:14.287971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:14.288456 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] [instance: f517d63c-e311-4c11-98b1-48e50f55b6fe] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:25:14.295570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:14.296201 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:14.296471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:14.297153 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:25:14.297596 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:25:14.298147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:25:14.306382 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:25:14.316022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] HTTP exception thrown: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Request method failure captured: Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe HTTP/1.1 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPo44oxrLCClSpnd61J_7greNRH-9dPvRouX1XmE5H6Nu_DiXc5fnRPYSjVUsIYAvqj43OFDS20PnL7MchstXtedNBjDgiWEiIf-rVNq15CK62tHfKpA5KQndf1FUgqYY7TQ0CsfkbY8ut8TtEs-KqHlnCypX11lLtDdmX2UOLfX0GiI Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:14.317549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d6a6c776cba64be9a1710815c0b0f952"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: d6a6c776cba64be9a1710815c0b0f952 Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-603424250 Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 9932c7fb57394d709a27023f3ae2677e Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-AttachVolumeNegativeTest-603424250-project Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.324019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'f517d63c-e311-4c11-98b1-48e50f55b6fe'} Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:14.324909 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. Oct 06 08:25:14.326871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:14.333299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] Returning 404 to user: Instance f517d63c-e311-4c11-98b1-48e50f55b6fe could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:14.333299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-703c869e-2689-457b-8980-64734b0355fa tempest-AttachVolumeNegativeTest-603424250 tempest-AttachVolumeNegativeTest-603424250-project] 10.222.0.30 "GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe" status: 404 len: 111 microversion: 2.1 time: 0.035279 Oct 06 08:25:14.333299 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 579/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:25:14 2022] GET /compute/v2.1/servers/f517d63c-e311-4c11-98b1-48e50f55b6fe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:19.762161 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9485615a-ac70-4ca7-84ad-cefd4ebb03f1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Action: 'create', calling method: .version_select at 0x7f9237b44c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1922352343"}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:25:20.472860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9485615a-ac70-4ca7-84ad-cefd4ebb03f1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.826035 Oct 06 08:25:20.473496 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 563/1142] 10.222.0.30 () {60 vars in 1155 bytes} [Thu Oct 6 08:25:19 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 827 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 06 08:25:20.487976 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-85b1a2f1-6413-4dd5-b15b-2d10ae5e9cb3 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923f4c7550>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:20.537546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-85b1a2f1-6413-4dd5-b15b-2d10ae5e9cb3 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.053811 Oct 06 08:25:20.538121 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 580/1143] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:20 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:21.555707 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d8c7dc23-968a-450d-ad63-5361a71194b1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237c56790>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:21.602381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d8c7dc23-968a-450d-ad63-5361a71194b1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.050851 Oct 06 08:25:21.603032 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 564/1144] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:21 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:22.618831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f912db7a-cdeb-41ee-9776-b194e0b186ca tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd18820>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:22.664668 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f912db7a-cdeb-41ee-9776-b194e0b186ca tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.050503 Oct 06 08:25:22.665317 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 581/1145] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:22 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:23.679454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bf5bf07a-4f5c-4dfe-a364-10c32f794a4c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237cbf280>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:23.725217 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bf5bf07a-4f5c-4dfe-a364-10c32f794a4c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.049982 Oct 06 08:25:23.725819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 565/1146] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:23 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:24.737394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:25:24.742799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6ee1b512-a9ac-4fff-bcf1-48499062c154 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd18820>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:24.789614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6ee1b512-a9ac-4fff-bcf1-48499062c154 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.053462 Oct 06 08:25:24.790175 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 582/1147] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:24 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:25.800925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:25:25.801614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:25:25.806535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a92d8910-7439-445b-baa1-bfa8e7ee02a3 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237db3790>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:25.853067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a92d8910-7439-445b-baa1-bfa8e7ee02a3 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.052493 Oct 06 08:25:25.853644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 566/1148] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:25 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:26.867660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6353a4c-b73b-44dd-a628-ffddbed3d715 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923f419160>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:26.913303 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b6353a4c-b73b-44dd-a628-ffddbed3d715 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.050303 Oct 06 08:25:26.913864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 583/1149] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:26 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:27.931419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-9077013d-8a2b-42f8-8b7d-7d5525480ad7 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f92379cb310>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:27.977602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-9077013d-8a2b-42f8-8b7d-7d5525480ad7 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.053935 Oct 06 08:25:27.978169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 567/1150] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:27 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:28.993161 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0d2b1d42-f2b5-4f69-8b36-18a8b6e5aa2c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd09ca0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:29.040086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0d2b1d42-f2b5-4f69-8b36-18a8b6e5aa2c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.051005 Oct 06 08:25:29.040492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 584/1151] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:28 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:25:30.055533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-35b948fa-5b81-4967-acdd-355032715ae6 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237b2b040>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:30.102823 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-35b948fa-5b81-4967-acdd-355032715ae6 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 346 microversion: 2.1 time: 0.052734 Oct 06 08:25:30.103435 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 568/1152] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:30 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:30.117890 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a2c3f108-b588-4196-b0e5-16ef5fc9a6f9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Action: 'create', calling method: .version_select at 0x7f923f31e0d0>, body: {"snapshot": {"volume_id": "b1b4558a-813d-472d-987c-e56155ee8932", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-461160093"}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:25:30.691928 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a2c3f108-b588-4196-b0e5-16ef5fc9a6f9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.579212 Oct 06 08:25:30.692638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 585/1153] 10.222.0.30 () {60 vars in 1162 bytes} [Thu Oct 6 08:25:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:30.703567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-56686a73-0859-4a85-973e-ab542bc5c94e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237a20790>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:30.735803 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-56686a73-0859-4a85-973e-ab542bc5c94e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.035996 Oct 06 08:25:30.736993 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 569/1154] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:30 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:30.747554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6b6262d-ae1d-46b9-930c-f6dc4f38ff43 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bf12a60>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:30.779746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b6b6262d-ae1d-46b9-930c-f6dc4f38ff43 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036004 Oct 06 08:25:30.780336 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 586/1155] 10.222.0.30 () {58 vars in 1140 bytes} [Thu Oct 6 08:25:30 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:25:30.791606 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-937d9a70-be2d-4fa1-b97a-1172e5271157 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237ee2e50>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:30.867291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-937d9a70-be2d-4fa1-b97a-1172e5271157 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.034608 Oct 06 08:25:30.867291 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 570/1156] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:30 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:31.878019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ae8a8042-de84-4d14-b1fb-c9954481fd07 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd18dc0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:31.907147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ae8a8042-de84-4d14-b1fb-c9954481fd07 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.033341 Oct 06 08:25:31.907700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 587/1157] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:31 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:32.919599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b7180038-cf45-4461-9120-0e2ee7ad42af tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237ec8f70>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:32.950783 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b7180038-cf45-4461-9120-0e2ee7ad42af tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.035465 Oct 06 08:25:32.951410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 571/1158] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:32 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:33.960369 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:25:33.965512 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b9a0a5c0-7505-43ff-9238-b8ed076f8db6 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bceb3a0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:33.995774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b9a0a5c0-7505-43ff-9238-b8ed076f8db6 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.036027 Oct 06 08:25:33.996395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 588/1159] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:33 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:35.009765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c84d98c5-cee9-4371-90cd-092e609e4022 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237a82c10>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:35.041551 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c84d98c5-cee9-4371-90cd-092e609e4022 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.036722 Oct 06 08:25:35.042108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 572/1160] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:35 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:36.055644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c61bce62-4310-43a7-a612-a783cfee93ee tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923f4c7160>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:36.089793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c61bce62-4310-43a7-a612-a783cfee93ee tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.038076 Oct 06 08:25:36.089793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 589/1161] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:36 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:37.102675 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e1b1f1b6-b379-46be-876f-8dfcd58b852d tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237db7820>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:37.131296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e1b1f1b6-b379-46be-876f-8dfcd58b852d tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.033590 Oct 06 08:25:37.131861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 573/1162] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:37 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:38.144826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4cfc7ba3-3efa-49c2-a446-a961f28b01b8 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bcc80d0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:38.174482 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4cfc7ba3-3efa-49c2-a446-a961f28b01b8 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.033932 Oct 06 08:25:38.175084 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 590/1163] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:38 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:39.188197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-50a360f7-7e9f-4c20-a692-fc22b13307ba tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237bbcd30>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:39.220059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-50a360f7-7e9f-4c20-a692-fc22b13307ba tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.036217 Oct 06 08:25:39.220625 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 574/1164] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:39 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:40.233499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fe6e5196-ed5b-440a-925e-23073d32dd02 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bceb670>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:40.263490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fe6e5196-ed5b-440a-925e-23073d32dd02 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.034385 Oct 06 08:25:40.264062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 591/1165] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:40 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:25:41.277954 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1d2d92b4-1f46-4dfe-a7f0-55f54a0e5a2e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237eba040>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:41.310919 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1d2d92b4-1f46-4dfe-a7f0-55f54a0e5a2e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 287 microversion: 2.1 time: 0.037889 Oct 06 08:25:41.311513 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 575/1166] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:41 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:41.324534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fa769c31-e1f1-419e-b86d-092df1293c2e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923f419160>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:41.497215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fa769c31-e1f1-419e-b86d-092df1293c2e tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 202 len: 0 microversion: 2.1 time: 0.178224 Oct 06 08:25:41.500343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 592/1167] 10.222.0.30 () {58 vars in 1254 bytes} [Thu Oct 6 08:25:41 2022] DELETE /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:25:41.508053 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f0d34b73-245a-47c1-ae95-153302e7e6f4 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237a204c0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:41.537334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f0d34b73-245a-47c1-ae95-153302e7e6f4 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 200 len: 286 microversion: 2.1 time: 0.033688 Oct 06 08:25:41.537901 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 576/1168] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:41 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:42.550872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f92d00db-32f7-4297-808d-c05a023c63a9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd3aee0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:42.583086 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-f92d00db-32f7-4297-808d-c05a023c63a9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] HTTP exception thrown: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f92d00db-32f7-4297-808d-c05a023c63a9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Request method failure captured: Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a HTTP/1.1 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpDvPeYsDx4Wx6bYEkYGu0eSL-JwdNNG3INoWt_ycJwOYIVjA3EofwDJiKvvWuxyGQUq_qG_EZh0cgIViJwhQnq6CL8P2lY4r43lvkVfFdpM0VidJe1PubEz09oIC2mOBhQSTV4VrNLiRsRAjDq6WKgu551T9_CtKrXNL_V7QKxKLns Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:42.585845 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 0c2df04b6e2349d99fa294990e37e023 Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '3418eb03-8cb4-4100-b19a-6d5642ce4b4a'} Oct 06 08:25:42.587634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. (HTTP 404) (Request-ID: req-e3dca530-74e1-46ad-99cf-7a69db7cd9ef) Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.588797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:42.590424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 06 08:25:42.592110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f92d00db-32f7-4297-808d-c05a023c63a9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Returning 404 to user: Snapshot 3418eb03-8cb4-4100-b19a-6d5642ce4b4a could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:42.593602 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f92d00db-32f7-4297-808d-c05a023c63a9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a" status: 404 len: 111 microversion: 2.1 time: 0.042396 Oct 06 08:25:42.594617 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 593/1169] 10.222.0.30 () {58 vars in 1251 bytes} [Thu Oct 6 08:25:42 2022] GET /compute/v2.1/os-snapshots/3418eb03-8cb4-4100-b19a-6d5642ce4b4a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:42.601464 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-215489fa-c90d-4476-b780-e77cb2abed7d tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237ec8e50>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:42.817684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-215489fa-c90d-4476-b780-e77cb2abed7d tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 202 len: 0 microversion: 2.1 time: 0.222198 Oct 06 08:25:42.818270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 577/1170] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:25:42 2022] DELETE /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:25:42.827775 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f54092bf-1f77-46f9-8577-115c7868300c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bd3adc0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:42.885586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f54092bf-1f77-46f9-8577-115c7868300c tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.062126 Oct 06 08:25:42.886153 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 594/1171] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:42 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:43.901839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-613358c6-8800-4b80-b6aa-b6dafe7572e2 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237ca9700>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:43.953390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-613358c6-8800-4b80-b6aa-b6dafe7572e2 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.055791 Oct 06 08:25:43.954339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 578/1172] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:43 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:44.968680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-fbbf47b6-42a2-4ebc-8de3-629f2e8c3560 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bf12a60>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:45.017534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-fbbf47b6-42a2-4ebc-8de3-629f2e8c3560 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.053170 Oct 06 08:25:45.018111 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 595/1173] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:44 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:46.033263 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-62659332-0c52-43de-b59c-8e3e0608a7b9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237c56160>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:46.082662 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-62659332-0c52-43de-b59c-8e3e0608a7b9 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.053720 Oct 06 08:25:46.092019 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 579/1174] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:46 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:47.104795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-223fc994-9761-473b-acee-95773ea323c1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bce51f0>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:47.152958 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-223fc994-9761-473b-acee-95773ea323c1 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 200 len: 345 microversion: 2.1 time: 0.052529 Oct 06 08:25:47.153540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 596/1175] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:47 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:25:48.167971 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a786051a-f58e-493a-859f-133701288a3f tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237b440d0>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:48.198459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-a786051a-f58e-493a-859f-133701288a3f tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] HTTP exception thrown: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a786051a-f58e-493a-859f-133701288a3f tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Request method failure captured: Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 HTTP/1.1 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpDvPeYsDx4Wx6bYEkYGu0eSL-JwdNNG3INoWt_ycJwOYIVjA3EofwDJiKvvWuxyGQUq_qG_EZh0cgIViJwhQnq6CL8P2lY4r43lvkVfFdpM0VidJe1PubEz09oIC2mOBhQSTV4VrNLiRsRAjDq6WKgu551T9_CtKrXNL_V7QKxKLns Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:48.200424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 0c2df04b6e2349d99fa294990e37e023 Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'b1b4558a-813d-472d-987c-e56155ee8932'} Oct 06 08:25:48.201840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. (HTTP 404) (Request-ID: req-b820de90-9405-4543-91e4-af69a2896788) Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.202706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:48.204316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 08:25:48.205757 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a786051a-f58e-493a-859f-133701288a3f tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Returning 404 to user: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a786051a-f58e-493a-859f-133701288a3f tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 404 len: 109 microversion: 2.1 time: 0.038836 Oct 06 08:25:48.207095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 580/1176] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:48 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:48.219055 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-95782544-f748-4223-9066-036f2ab0d8f0 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f923bf7a310>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:48.248721 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-95782544-f748-4223-9066-036f2ab0d8f0 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] HTTP exception thrown: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-95782544-f748-4223-9066-036f2ab0d8f0 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Request method failure captured: Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: DELETE /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 HTTP/1.1 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpDvPeYsDx4Wx6bYEkYGu0eSL-JwdNNG3INoWt_ycJwOYIVjA3EofwDJiKvvWuxyGQUq_qG_EZh0cgIViJwhQnq6CL8P2lY4r43lvkVfFdpM0VidJe1PubEz09oIC2mOBhQSTV4VrNLiRsRAjDq6WKgu551T9_CtKrXNL_V7QKxKLns Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:25:48.249638 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 0c2df04b6e2349d99fa294990e37e023 Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': 'b1b4558a-813d-472d-987c-e56155ee8932'} Oct 06 08:25:48.251164 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. (HTTP 404) (Request-ID: req-be018332-691b-40ea-b09a-cfdde0bc3de3) Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.252017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 06 08:25:48.253212 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 06 08:25:48.254404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-95782544-f748-4223-9066-036f2ab0d8f0 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Returning 404 to user: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:48.256006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-95782544-f748-4223-9066-036f2ab0d8f0 tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 404 len: 109 microversion: 2.1 time: 0.037167 Oct 06 08:25:48.257548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 597/1177] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:25:48 2022] DELETE /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:25:48.260810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86963b90-1910-4ccb-ba18-4b4c75b3134b tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Calling method '.version_select at 0x7f9237c56e50>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:25:48.289567 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-86963b90-1910-4ccb-ba18-4b4c75b3134b tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] HTTP exception thrown: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86963b90-1910-4ccb-ba18-4b4c75b3134b tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Request method failure captured: Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 HTTP/1.1 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpDvPeYsDx4Wx6bYEkYGu0eSL-JwdNNG3INoWt_ycJwOYIVjA3EofwDJiKvvWuxyGQUq_qG_EZh0cgIViJwhQnq6CL8P2lY4r43lvkVfFdpM0VidJe1PubEz09oIC2mOBhQSTV4VrNLiRsRAjDq6WKgu551T9_CtKrXNL_V7QKxKLns Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:25:48.291541 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c55402c6b2c74ceb87b34e6ed893f426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: c55402c6b2c74ceb87b34e6ed893f426 Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1558005171 Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 0c2df04b6e2349d99fa294990e37e023 Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1558005171-project Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': 'b1b4558a-813d-472d-987c-e56155ee8932'} Oct 06 08:25:48.293046 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. (HTTP 404) (Request-ID: req-fa81fef3-ca96-4d67-9c80-68696e964a99) Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.293960 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 06 08:25:48.295330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 06 08:25:48.296602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86963b90-1910-4ccb-ba18-4b4c75b3134b tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] Returning 404 to user: Volume b1b4558a-813d-472d-987c-e56155ee8932 could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-86963b90-1910-4ccb-ba18-4b4c75b3134b tempest-VolumesSnapshotsTestJSON-1558005171 tempest-VolumesSnapshotsTestJSON-1558005171-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932" status: 404 len: 109 microversion: 2.1 time: 0.036800 Oct 06 08:25:48.297791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 581/1178] 10.222.0.30 () {58 vars in 1245 bytes} [Thu Oct 6 08:25:48 2022] GET /compute/v2.1/os-volumes/b1b4558a-813d-472d-987c-e56155ee8932 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:26:06.210881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1d2a010a-d3eb-4dd8-aad1-4f32e86b1181 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Action: 'create', calling method: .version_select at 0x7f923bcebca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1438726332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhktjwyQEUpV76JKFeyDT/kxdd3/P5RbLb88CCbjBO/hsaurMCrU4xFIjSnf5ibpDT/P7Mb0Dik4UWNxfp1KzOmD0E5/D8ubjLwJX2C4YT/vzvizEtYX2D75ikKmw1tng=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:26:06.227739 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-1d2a010a-d3eb-4dd8-aad1-4f32e86b1181 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for project fd1ef1a189d5485fb810e17c945b295f. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:26:06.232650 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-1d2a010a-d3eb-4dd8-aad1-4f32e86b1181 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for user 79d29aa9482f4c1f9b1554333d85d80a and project fd1ef1a189d5485fb810e17c945b295f. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:26:06.344136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1d2a010a-d3eb-4dd8-aad1-4f32e86b1181 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.491400 Oct 06 08:26:06.352675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 598/1179] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:26:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:26:45.532208 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1106326258", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726332", "security_groups": [{"name": "tempest-secgroup-smoke-374011883"}], "block_device_mapping_v2": [{"uuid": "82ea641a-520a-4bfc-80e6-80a570adbf07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d"}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:26:45.654316 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] validate_networks() for [('8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:26:46.041393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:26:46.041820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:26:46.042328 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:26:46.042739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:26:46.043197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:26:46.052650 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:46.053133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:46.053568 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:46.054297 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:46.054754 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:46.055211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:46.072362 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:26:46.076492 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for user 79d29aa9482f4c1f9b1554333d85d80a and project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:26:46.133523 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:26:46.135665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82ea641a-520a-4bfc-80e6-80a570adbf07',volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:26:46.607806 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6f72682d-abfb-489e-9bd9-684846d8d538 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.081482 Oct 06 08:26:46.608909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 582/1180] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:26:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:26:46.619857 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6ef879fe-702e-40b7-a685-f07d3fb15f1e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:46.620651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6ef879fe-702e-40b7-a685-f07d3fb15f1e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:46.622897 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:26:46.623908 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:26:46.624859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 08:26:46.625089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Thu Oct 6 08:26:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f (ip 10.222.0.30) !!! Oct 06 08:26:46.688087 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6ef879fe-702e-40b7-a685-f07d3fb15f1e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:46.695997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6ef879fe-702e-40b7-a685-f07d3fb15f1e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1095 microversion: 2.1 time: 0.079984 Oct 06 08:26:46.696502 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 599/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:46 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:26:47.720162 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e067a832-d38e-4c54-aa3e-cd18304bf951 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:47.720892 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e067a832-d38e-4c54-aa3e-cd18304bf951 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:47.774872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e067a832-d38e-4c54-aa3e-cd18304bf951 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:47.782910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e067a832-d38e-4c54-aa3e-cd18304bf951 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1095 microversion: 2.1 time: 0.067715 Oct 06 08:26:47.783504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 583/1182] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:47 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:48.805738 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:48.806371 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:48.814400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:48.817566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:48.817566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:48.817566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:48.817566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:48.817960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:48.880627 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:48.888400 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7a3dc67b-15e0-47e5-97f8-e88813bd272c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1193 microversion: 2.1 time: 0.086572 Oct 06 08:26:48.889109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 600/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:48 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:49.923766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:49.924621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:49.931192 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:49.931995 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:49.932524 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:49.933334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:49.934003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:49.934634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:50.087725 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:50.096473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-273b9815-6ba5-4316-bcc8-4f24dc6630bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1278 microversion: 2.1 time: 0.178611 Oct 06 08:26:50.097113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 584/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:49 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:50.928205 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73331146-6ebd-4051-970c-554567f5c44f", "tag": "3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:26:50.938539 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:50.943399 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:50.943879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:50.961463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] Creating event network-changed:3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55 for instance 73331146-6ebd-4051-970c-554567f5c44f on hv-cinder-86021 Oct 06 08:26:50.963326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-8d9c74ea-04fc-4b86-94c2-2a19143dae78 req-03d8db95-7946-4631-89a8-b5184adf2cb3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038842 Oct 06 08:26:50.964280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 601/1185] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:26:51.131015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:51.131015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:51.131015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:51.131015 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:51.131787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:51.131787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:51.131787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:51.131787 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:51.280804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:51.289025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b4be4aa4-e5bd-4ac4-ab48-694523a045b3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.171575 Oct 06 08:26:51.290161 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 585/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:51 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:52.313892 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:52.320795 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:52.321211 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:52.321562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:52.321907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:52.322611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:52.323090 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:52.323518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:52.461039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:52.469241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-aace8f39-e779-484e-8a57-5c98787b9242 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.160524 Oct 06 08:26:52.469820 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 602/1187] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:52 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:53.492276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:53.492887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:53.500244 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:53.500734 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:53.501168 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:53.501853 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:53.502302 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:53.502726 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:53.636816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:53.644667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-82bc8f20-b00c-4069-aeb2-9494f0de3130 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.156303 Oct 06 08:26:53.645230 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 586/1188] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:53 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:54.667313 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:54.668062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:54.674792 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:54.675419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:54.675926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:54.676744 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:54.677277 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:54.677808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:54.811926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:54.820749 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-76b86dc5-a0a1-4543-a97b-de6dcb897fac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.158116 Oct 06 08:26:54.821422 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 603/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:54 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:55.845370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:55.846028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:55.852669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:55.853159 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:55.853601 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:55.854293 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:55.854746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:55.855195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:55.989958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:55.999028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b6a73daf-ef48-476f-b3f2-e303e3b10623 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.157411 Oct 06 08:26:55.999614 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 587/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:55 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:57.022260 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:57.022924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:57.025425 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:26:57.030363 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:57.030852 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:57.031311 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:57.032011 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:57.032464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:57.032888 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:57.175248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:57.182978 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-066c685c-9ff0-4b6e-a459-18bc77ac21dd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.164571 Oct 06 08:26:57.183550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 604/1191] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:57 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:58.206852 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:58.208742 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:58.217439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:26:58.218262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=8 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:26:58.220812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:58.221311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:58.221987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:58.222794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:58.223323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:58.224027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:58.362112 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:58.369737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7a5173bb-cfea-45b7-be5e-86da04915192 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.167045 Oct 06 08:26:58.370309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 588/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:58 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:26:59.392526 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:26:59.393134 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:26:59.399480 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:59.399959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:59.400437 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:59.401139 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:26:59.401611 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:26:59.402019 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:26:59.535876 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:26:59.543823 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5ac61ed6-54fc-403c-9c84-56e417b76de5 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.155825 Oct 06 08:26:59.544434 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 605/1193] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:26:59 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:00.566075 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:00.570082 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:00.573450 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:00.573926 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:00.574354 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:00.575058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:00.575935 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:00.575935 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:00.711737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:00.724847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-41a85f6c-6876-4965-855b-1e0e1addd24c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.159027 Oct 06 08:27:00.724847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 589/1194] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:00 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:01.744810 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:01.745462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:01.753337 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:01.754073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:01.754735 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:01.755466 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:01.755926 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:01.756455 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:01.894151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:01.901913 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ce5fbbb4-6ef9-4a2f-953a-a3d3ca23b0bf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.161053 Oct 06 08:27:01.902474 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 606/1195] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:01 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:02.924875 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:02.925517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:02.931830 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:02.932306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:02.932736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:02.933413 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:02.933859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:02.934275 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:03.064445 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:03.072189 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-09c577b8-b3eb-4001-95bb-795c8a314050 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.151135 Oct 06 08:27:03.072753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 590/1196] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:02 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:04.097258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:04.097826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:04.104245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:04.104725 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:04.105181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:04.105874 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:04.106324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:04.107280 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:04.237113 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:04.245215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-11928fb3-31e2-417a-81cf-2f3372ae03c0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.153325 Oct 06 08:27:04.245778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 607/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:04 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:05.268308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:05.268910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:05.275299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:05.275782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:05.276210 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:05.276880 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:05.277323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:05.277739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:05.409904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:05.417537 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-edec1932-ed87-4a60-8dee-5c40d0876ccc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.153316 Oct 06 08:27:05.418102 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 591/1198] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:05 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:06.440511 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:06.441051 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:06.447687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:06.448166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:06.448597 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:06.449282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:06.449723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:06.450756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:06.583309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:06.591094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6572fa0b-e95a-498d-91f6-9211949f6e67 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.154286 Oct 06 08:27:06.591661 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 608/1199] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:06 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:07.613753 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:07.614377 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:07.620924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:07.621411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:07.621854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:07.622832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:07.623321 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:07.623747 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:07.756928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:07.765403 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-79bbb3cc-32d7-47d0-bbd3-3a6f948ff8d6 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.155560 Oct 06 08:27:07.766237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 592/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:07 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:08.789367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:08.789959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:08.797149 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:08.797633 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:08.798085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:08.798752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:08.799279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:08.799707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:08.939118 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:08.946870 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f1ef365d-ebe2-4696-b150-bd2d3b08a9c3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.161383 Oct 06 08:27:08.947588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 609/1201] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:08 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:09.970023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:09.970565 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:09.977128 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:09.977607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:09.978040 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:09.978721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:09.979197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:09.979616 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:10.111480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:10.119167 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-628ef36b-ec4d-486e-9e21-0f1f9349c9b4 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.153458 Oct 06 08:27:10.119730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 593/1202] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:09 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:10.600266 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73331146-6ebd-4051-970c-554567f5c44f", "name": "network-vif-plugged", "status": "completed", "tag": "3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:27:10.610018 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:10.610649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:10.611039 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:10.622514 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] Creating event network-vif-plugged:3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55 for instance 73331146-6ebd-4051-970c-554567f5c44f on hv-cinder-86021 Oct 06 08:27:10.628306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-6f549c69-f009-48aa-9ca2-9d31154ea500 req-b54416a5-5360-41ff-81a2-66267316630a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152207 Oct 06 08:27:10.628918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 610/1203] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:27:11.142532 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:11.143458 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:11.150928 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:11.151736 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:11.153619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:11.153619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:11.154114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:11.154604 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:11.301493 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:11.309487 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-e050119d-16fc-4dec-968d-905c5664c06c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.171271 Oct 06 08:27:11.310047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 594/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:11 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:12.333243 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:12.333947 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:12.340151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:12.340640 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:12.341187 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:12.341747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:12.342410 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:12.342877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:12.484277 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:12.496790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-18d8bf3c-d77a-4f76-9b3c-3a45c05ab176 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1266 microversion: 2.1 time: 0.164946 Oct 06 08:27:12.496790 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 611/1205] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:12 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:27:13.521221 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:13.521841 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:13.528695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:13.529188 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:13.530482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:13.531234 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:13.531688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:13.532117 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:13.675940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:13.684366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4a463ed0-22db-41ac-acc2-7dbd1cd277f9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1453 microversion: 2.1 time: 0.167245 Oct 06 08:27:13.685074 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 595/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:13 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:13.707338 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:13.708024 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:13.714813 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:13.715360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:13.715797 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:13.716487 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:13.717530 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:13.717967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:13.856033 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:13.863839 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a5d3c4d7-f2b8-4a5f-a938-699b244feabb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1453 microversion: 2.1 time: 0.160408 Oct 06 08:27:13.864409 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 612/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:13 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:16.592414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73331146-6ebd-4051-970c-554567f5c44f", "tag": "3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:27:16.602868 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:16.605372 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:16.606576 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:16.607281 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:16.612528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=75 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:16.623860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] Creating event network-changed:3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55 for instance 73331146-6ebd-4051-970c-554567f5c44f on hv-cinder-86021 Oct 06 08:27:16.628163 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR oslo.messaging._drivers.impl_rabbit [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] [34ea519c-2a85-4122-9c98-29bc4a22392a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 08:27:17.643374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO oslo.messaging._drivers.impl_rabbit [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] [34ea519c-2a85-4122-9c98-29bc4a22392a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 39876. Oct 06 08:27:17.649909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-ef972f09-ba92-4ab5-952e-7455054ad051 req-eed49414-6cca-4529-915e-ed55f2388abd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.277050 Oct 06 08:27:17.651552 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 596/1208] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:27:30.438956 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=30 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:30.439740 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=70 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:30.618802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c18f05f0-68dd-4f7c-96b5-122627bba4ab tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Action: 'create', calling method: .version_select at 0x7f923f4c7310>, body: {"keypair": {"name": "tempest-TestShelveInstance-22774121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIa1SP0Ihi1dRGXmPYk1+4WsZsk1paCh/lFS1inYWXoq+G4ozQYr6OAkozefgRYSi4odtdVCsEmbMQcGq/pMuIvxq3YAOW1qIN+OcWlX8rc93ZfysUimwoDfWpr+ckSpQA=="}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:27:30.635919 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-c18f05f0-68dd-4f7c-96b5-122627bba4ab tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Getting quotas for project 7cc3f986a0af4426b9995cdcaa66c1b0. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:27:30.640545 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-c18f05f0-68dd-4f7c-96b5-122627bba4ab tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Getting quotas for user 3d6e390b824c41bc91fbd83f922cae97 and project 7cc3f986a0af4426b9995cdcaa66c1b0. Resources: {'key_pairs'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:27:30.770122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c18f05f0-68dd-4f7c-96b5-122627bba4ab tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.336184 Oct 06 08:27:30.771331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 613/1209] 10.222.0.30 () {60 vars in 1159 bytes} [Thu Oct 6 08:27:30 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:27:55.196711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:55.201933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:55.201933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-4174331", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-22774121", "security_groups": [{"name": "tempest-secgroup-smoke-2043682298"}], "networks": [{"uuid": "ad4de46d-478e-4974-a9b0-40d70f26d458"}], "block_device_mapping_v2": [{"uuid": "9bb4ff56-dccc-4c63-9aa1-e79e40d3153b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:27:55.315036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] validate_networks() for [('ad4de46d-478e-4974-a9b0-40d70f26d458', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:27:55.767983 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:27:55.768411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:27:55.768887 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:27:55.769298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:27:55.769709 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:27:55.778449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:55.778924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:55.779385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:55.780108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:27:55.780557 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:27:55.780979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:27:55.804690 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Getting quotas for project 7cc3f986a0af4426b9995cdcaa66c1b0. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:27:55.808844 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Getting quotas for user 3d6e390b824c41bc91fbd83f922cae97 and project 7cc3f986a0af4426b9995cdcaa66c1b0. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:27:55.869374 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:27:55.871644 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9bb4ff56-dccc-4c63-9aa1-e79e40d3153b',volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:27:56.259883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-56956ce3-0e57-414c-aa7d-8aa23c7e479b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.064978 Oct 06 08:27:56.263473 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 597/1210] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:27:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:27:56.272826 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b0ac7a5a-2cfd-4c5c-94f5-1272d2b099d5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:56.273436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b0ac7a5a-2cfd-4c5c-94f5-1272d2b099d5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:56.275568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:56.276305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:27:56.326835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b0ac7a5a-2cfd-4c5c-94f5-1272d2b099d5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:56.334431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b0ac7a5a-2cfd-4c5c-94f5-1272d2b099d5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1084 microversion: 2.1 time: 0.065978 Oct 06 08:27:56.342132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 614/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:56 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1084 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:57.357424 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-eae148c7-a4f8-40d0-9e83-53554fb4c9bb tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:57.358037 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-eae148c7-a4f8-40d0-9e83-53554fb4c9bb tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:57.411528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-eae148c7-a4f8-40d0-9e83-53554fb4c9bb tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:57.418294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-eae148c7-a4f8-40d0-9e83-53554fb4c9bb tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1084 microversion: 2.1 time: 0.065135 Oct 06 08:27:57.418858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 598/1212] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:57 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1084 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:58.441465 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5a212eda-206f-4d6d-ac48-5dddf24164cc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:58.442112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5a212eda-206f-4d6d-ac48-5dddf24164cc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:58.502590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5a212eda-206f-4d6d-ac48-5dddf24164cc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:58.510771 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5a212eda-206f-4d6d-ac48-5dddf24164cc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1084 microversion: 2.1 time: 0.073096 Oct 06 08:27:58.511391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 615/1213] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:58 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1084 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:27:59.534278 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8f2895b8-6483-41cf-8224-b8eaa57d114d tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:27:59.534883 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8f2895b8-6483-41cf-8224-b8eaa57d114d tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:27:59.589647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8f2895b8-6483-41cf-8224-b8eaa57d114d tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:27:59.597663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8f2895b8-6483-41cf-8224-b8eaa57d114d tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1084 microversion: 2.1 time: 0.067853 Oct 06 08:27:59.598221 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 599/1214] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:27:59 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1084 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:00.620556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:00.621168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:00.628183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:00.628666 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:00.629103 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:00.629789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:00.630239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:00.630660 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:00.691498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:00.699022 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-74dae61a-5140-464b-ac47-5e4f75c379f4 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1134 microversion: 2.1 time: 0.082356 Oct 06 08:28:00.699600 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 616/1215] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:00 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1134 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:01.722153 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:01.722776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:01.729563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:01.730045 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:01.730481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:01.731200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:01.731653 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:01.732078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:01.794911 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:01.803097 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-97ef0076-1d77-47c5-a708-87a356cbb876 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1134 microversion: 2.1 time: 0.085534 Oct 06 08:28:01.803646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 600/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:01 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1134 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:02.825680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:02.826276 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:02.833648 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:02.835089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:02.835089 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:02.835423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:02.835868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:02.836287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:02.916010 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:02.924868 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2ec0bc0e-1769-4e28-9d3e-5341959edc12 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1190 microversion: 2.1 time: 0.103034 Oct 06 08:28:02.925542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 617/1217] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:02 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1190 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:03.948864 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:03.949711 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:03.956303 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:03.959366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:03.959366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:03.959366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:03.959366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:03.959980 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:04.092735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:04.102127 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-51a78b3a-4ea5-4218-8d6e-30d854c9e6f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1268 microversion: 2.1 time: 0.157191 Oct 06 08:28:04.102647 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 601/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:03 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:04.397373 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:28:04.407406 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:04.407885 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:04.408309 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:04.421900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] Creating event network-changed:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:28:04.427200 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-a91dfb07-663b-42d6-9055-ce739c58f2b3 req-242f9204-1d67-4841-a51e-f6419bf88f6a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033556 Oct 06 08:28:04.428799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 618/1219] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:28:05.125755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:05.126432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:05.135142 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:05.142057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:05.142057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:05.142057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:05.142057 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:05.142519 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:05.276791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:05.285306 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-93f75af9-cb68-489e-b6e6-e7df75e3b1f3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.163526 Oct 06 08:28:05.293527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 602/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:05 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:06.308899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:06.309595 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:06.316413 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:06.316895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:06.317331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:06.318068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:06.318522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:06.318967 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:06.454550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:06.462178 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f14f6acd-4bf0-4329-a73e-5e0bbb6342aa tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.158000 Oct 06 08:28:06.462743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 619/1221] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:06 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:28:07.485027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:07.485659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:07.487534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:28:07.493003 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:07.493481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:07.493943 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:07.494627 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:07.495113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:07.501346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:07.626170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:07.633564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-d2ee550f-d094-4103-b239-299d14bcc9f6 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.152736 Oct 06 08:28:07.634138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 603/1222] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:07 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:08.657081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:08.658014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:08.660443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=4 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:28:08.665284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:08.665768 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:08.666206 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:08.666893 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:08.667367 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:08.667788 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:08.799005 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:08.806645 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e5b81569-15b4-4335-a89c-5e222883ccd3 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.154044 Oct 06 08:28:08.807289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 620/1223] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:08 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:09.829699 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:09.830309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:09.832660 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=10 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:28:09.837466 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:09.837949 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:09.838384 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:09.839114 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:09.839577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:09.840002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:09.967613 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:09.975968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-adf4af16-2303-413a-8ff3-4600f4ce7291 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.150668 Oct 06 08:28:09.976545 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 604/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:09 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:10.997586 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:10.998184 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:11.004881 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:11.005407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:11.005850 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:11.006542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:11.007029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:11.007459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:11.145324 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:11.153179 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e8184063-dbde-4053-8ced-7e663939b7a0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.159418 Oct 06 08:28:11.154016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 621/1225] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:10 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:12.177118 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:12.177729 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:12.184309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:12.184789 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:12.185219 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:12.185893 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:12.186338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:12.186751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:12.318667 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:12.326547 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-62bd4987-b7aa-4591-b1dd-9ce7819f74ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.153519 Oct 06 08:28:12.329471 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 605/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:12 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:13.350436 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:13.351080 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:13.357481 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:13.357963 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:13.358394 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:13.359106 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:13.360360 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:13.360946 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:13.495440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:13.503951 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-4de1c0e2-8695-48d9-af21-4a792e77b3ba tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.157275 Oct 06 08:28:13.504535 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 622/1227] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:13 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:14.527619 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:14.528220 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:14.534671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:14.535176 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:14.535604 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:14.536276 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:14.536786 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:14.537205 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:14.666890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:14.675443 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fc0e821c-abe3-4cdd-a900-26f55f784980 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.151655 Oct 06 08:28:14.676058 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 606/1228] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:14 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:14.793196 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "name": "network-vif-plugged", "status": "completed", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:28:14.803751 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:14.804218 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:14.804641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:14.815742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] Creating event network-vif-plugged:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:28:14.821041 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-1a4ec5fa-4be3-40dd-a217-da82d1003da3 req-63d67e48-8bd0-4390-b01d-ccf71b606919 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031632 Oct 06 08:28:14.821625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 623/1229] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:28:15.697907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:15.698512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:15.708940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:15.708940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:15.708940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:15.708940 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:15.709401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:15.709594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:15.845922 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:15.853528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-34376889-21b2-4977-b8c8-f86a362621dc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.159504 Oct 06 08:28:15.854094 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 607/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:15 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:16.878098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:16.878798 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:16.885468 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:16.885944 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:16.886377 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:16.887088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:16.887537 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:16.887954 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:17.026124 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:17.034551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-599c65e9-4a6b-45e9-982b-8c62a9ec68c7 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1256 microversion: 2.1 time: 0.161281 Oct 06 08:28:17.035146 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 624/1231] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:16 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1256 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:18.057563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:18.058173 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:18.065408 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:18.065896 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:18.066333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:18.067055 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:18.067509 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:18.067934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:18.197073 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:18.205005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-02d3246d-c19e-4c4c-826d-59379ac862ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1441 microversion: 2.1 time: 0.151281 Oct 06 08:28:18.205577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 608/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:18 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1441 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:18.226589 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:28:18.227233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:28:18.233630 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:18.234626 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:18.235127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:18.235827 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:18.236284 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:18.236713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:18.366634 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:28:18.374314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d2245309-1351-41a2-bc55-6e74f194f316 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1441 microversion: 2.1 time: 0.151549 Oct 06 08:28:18.375497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 625/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:28:18 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1441 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:28:20.554298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:28:20.564634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:28:20.565166 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:28:20.565607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:28:20.576663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] Creating event network-changed:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:28:20.582615 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-ec60be6c-4d6f-4a2a-9bf9-e5e857b0ba17 req-9579a59a-1e5a-4d4d-a99a-8c40a45107b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032030 Oct 06 08:28:20.583333 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 609/1234] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:29:40.581188 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=28 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:40.581929 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=52 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:40.585996 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:40.586483 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:40.592463 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:40.592935 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:40.593358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:40.594035 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:40.594479 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:40.594895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:40.619647 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:29:40.967197 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c27af615-c7ec-4c4d-9045-374c9def94bb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "DELETE /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 204 len: 0 microversion: 2.1 time: 0.388333 Oct 06 08:29:40.968477 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 626/1235] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:29:40 2022] DELETE /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:29:40.975548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 08:29:40.976034 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Thu Oct 6 08:29:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f (ip 10.222.0.30) !!! Oct 06 08:29:40.977639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:40.978394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=58 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:40.983990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:40.986569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:40.992319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:40.992802 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:40.993236 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:40.993925 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:40.994380 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:40.994806 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:41.184201 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:41.192204 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c9aa92e1-6b3f-4071-9685-f8352dc00824 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1578 microversion: 2.1 time: 0.219269 Oct 06 08:29:41.192768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 610/1236] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:40 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1578 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:42.226064 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:42.226756 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:42.233591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:42.234067 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:42.234498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:42.235754 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:42.236202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:42.236620 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:42.416103 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:42.424549 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-666f5e2e-2f61-4cdd-9f26-8d3ab63538c9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1578 microversion: 2.1 time: 0.202667 Oct 06 08:29:42.425116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 627/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:42 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1578 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:43.447739 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:43.448310 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:43.455254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:43.455745 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:43.456190 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:43.456886 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:43.457339 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:43.457767 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:43.598144 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:43.606066 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f564ce95-7592-4636-96e1-5990a06d4488 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1578 microversion: 2.1 time: 0.162322 Oct 06 08:29:43.610782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 611/1238] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:43 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:44.023009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73331146-6ebd-4051-970c-554567f5c44f", "name": "network-vif-deleted", "tag": "3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:29:44.033635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:44.034168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:44.034598 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:44.046267 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] Creating event network-vif-deleted:3b7d3ff5-3a91-4bc7-a016-1aa5b98fba55 for instance 73331146-6ebd-4051-970c-554567f5c44f on hv-cinder-86021 Oct 06 08:29:44.051763 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-3205fc2b-4fde-45ab-b1b6-65f6392f19fa req-a77bf4d0-15a5-410c-b940-648d59bc0c9e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033472 Oct 06 08:29:44.052532 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 628/1239] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:29:44.630031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:44.630812 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:44.637357 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:44.637839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:44.638268 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:44.638968 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:44.646052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:44.646052 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:44.707867 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:44.715679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-210a5734-0253-4a6c-b520-be8db0a084d2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 200 len: 1226 microversion: 2.1 time: 0.090071 Oct 06 08:29:44.716253 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 612/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:44 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:45.741216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:45.741936 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:45.748081 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:45.749241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:45.749686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:45.750362 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:45.750808 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:45.751256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:45.764174 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] HTTP exception thrown: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Request method failure captured: Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f HTTP/1.1 Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpEVT_xlQ55FvgcxSL758uKl1ja4OTnGz-5mheGasM-2FoSo5dDyxdcbLEN-8IzBUECbr3UCGVLtYMvasTuHPTexydyAfG7AQMtUWwGLL0RZ3Z6nKXlJBl1vHl00haRmbET9I0djd6IWt6M8iBFvBpbua8buJaBN50YzA9vPP5bAYTw Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:29:45.765838 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 79d29aa9482f4c1f9b1554333d85d80a Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:29:45.767900 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '73331146-6ebd-4051-970c-554567f5c44f'} Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:29:45.768999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:29:45.770706 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:29:45.772216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Returning 404 to user: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:29:45.772216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-87e78960-6b3e-413c-b51e-308e6a9adef3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 404 len: 111 microversion: 2.1 time: 0.030917 Oct 06 08:29:45.772216 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 629/1241] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:45 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:29:45.865510 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-875773804", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726332", "security_groups": [{"name": "tempest-secgroup-smoke-374011883"}], "block_device_mapping_v2": [{"uuid": "82ea641a-520a-4bfc-80e6-80a570adbf07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d"}]}} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:29:45.976721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.network.neutron [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] validate_networks() for [('8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d', None, None, None, None, None)] {{(pid=121076) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:29:46.361029 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:29:46.361504 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image limits 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:29:46.361984 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:29:46.362393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image pref 0:0:0 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:29:46.362807 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.virt.hardware [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121076) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:29:46.372125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:46.372607 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:46.373037 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:46.374008 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:46.374577 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:46.375095 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:46.395797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:29:46.399906 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.quota [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for user 79d29aa9482f4c1f9b1554333d85d80a and project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121076) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:29:46.472033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Going to run 1 instances... {{(pid=121076) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:29:46.475285 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82ea641a-520a-4bfc-80e6-80a570adbf07',volume_size=None,volume_type=None)] {{(pid=121076) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:29:46.876318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-911d08fb-b9c9-400a-bb3f-73a3d80ab034 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.014596 Oct 06 08:29:46.877023 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 613/1242] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:29:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:29:46.888318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-be398498-e072-4ee0-bf66-e0732b52cf55 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:46.889692 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-be398498-e072-4ee0-bf66-e0732b52cf55 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:46.954376 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-be398498-e072-4ee0-bf66-e0732b52cf55 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:46.962198 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-be398498-e072-4ee0-bf66-e0732b52cf55 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1094 microversion: 2.1 time: 0.077708 Oct 06 08:29:46.962780 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 630/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:46 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:47.987110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:47.987833 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:47.993854 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:47.994332 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:47.994769 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:47.995490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:47.995946 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:47.996368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:48.060233 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:48.068640 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2e438966-a294-49ec-a500-0f17081e9f81 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1144 microversion: 2.1 time: 0.086972 Oct 06 08:29:48.069223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 614/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:47 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:49.091605 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:49.092204 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:49.099754 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:49.100240 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:49.100678 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:49.101372 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:49.101825 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:49.102300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:49.205104 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:49.213356 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b6f090b2-f555-410c-9f3f-bff9b50f7ff9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1200 microversion: 2.1 time: 0.125648 Oct 06 08:29:49.213932 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 631/1245] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:49 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1200 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:50.237104 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:50.237706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:50.244036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:50.247390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:50.247390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:50.247390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:50.247390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:50.247849 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:50.381907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:50.389590 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a1466f1d-cac3-4427-a810-3ab5718f143b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1277 microversion: 2.1 time: 0.156387 Oct 06 08:29:50.390161 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 615/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:50 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:50.813933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f", "tag": "866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:29:50.863458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:50.863994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:50.869863 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:50.876259 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] Creating event network-changed:866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99 for instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f on hv-cinder-86021 Oct 06 08:29:50.881469 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-45e93093-879a-4368-bf3c-7ba83be28a2b req-2d0ecfaf-6e9f-4f0b-a393-179c1810a4ff service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072325 Oct 06 08:29:50.882082 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 632/1247] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:29:51.417669 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:51.418270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:51.425553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:51.426031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:51.426459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:51.427186 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:51.427632 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:51.428049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:51.564587 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:51.572604 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bc0fba43-8c27-4e48-95e2-69d077cb9b6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.163028 Oct 06 08:29:51.573198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 616/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:51 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:29:52.596615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:52.597306 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:52.603922 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:52.604401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:52.604830 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:52.605537 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:52.605993 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:52.606407 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:52.735904 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:52.743641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-ff64364b-012a-47e7-a79c-bc2e778a260b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.151394 Oct 06 08:29:52.744221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 633/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:52 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:53.767611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:53.768195 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:53.774563 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:53.775068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:53.775499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:53.776177 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:53.776621 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:53.777037 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:53.906735 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:53.914528 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fe422af8-1005-4570-8b60-39a804f46eb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.151775 Oct 06 08:29:53.915266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 617/1250] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:53 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:54.937331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:54.938255 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:54.944391 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:54.944877 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:54.945312 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:54.945999 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:54.946451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:54.946878 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:55.074415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:55.082068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3f21d47f-25ac-450a-bd3e-97484a4b44a0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.148733 Oct 06 08:29:55.082635 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 634/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:54 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:56.105498 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:56.106038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:56.112961 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:56.113432 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:56.113859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:56.114529 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:56.114999 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:56.115414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:56.249452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:56.257889 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f7e1a599-9d04-4b00-8651-5a1a0e840a4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.156422 Oct 06 08:29:56.258495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 618/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:56 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:57.280625 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:57.281742 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:57.284183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:57.288994 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:57.289471 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:57.289907 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:57.290591 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:57.291073 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:57.302458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:57.425182 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:57.435322 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f9a89bba-3b6d-402b-808d-e29eaf7aabcf tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.158848 Oct 06 08:29:57.435895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 635/1253] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:57 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:58.458449 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:58.458997 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:58.460802 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:58.461460 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=6 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:29:58.466685 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:58.467193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:58.467623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:58.468298 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:58.469526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:58.469900 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:58.603109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:58.610819 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c82b3e71-72b5-4fc6-91a9-30091d9a1ab3 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.156514 Oct 06 08:29:58.611410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 619/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:58 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:29:59.633807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:29:59.634533 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:29:59.642652 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:59.643171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:59.643610 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:59.644314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:29:59.644766 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:29:59.645193 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:29:59.777799 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:29:59.786144 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0fd3e662-d5de-47d3-89d2-447b79bea641 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.156277 Oct 06 08:29:59.786730 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 636/1255] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:29:59 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:00.809265 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:00.809859 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:00.829440 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:00.829931 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:00.830361 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:00.831087 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:00.831533 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:00.831952 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:00.965760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:00.973766 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-94c8dcd1-3850-4ed9-9248-42726656bb4d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.168521 Oct 06 08:30:00.974336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 620/1256] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:00 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:01.335499 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f", "name": "network-vif-plugged", "status": "completed", "tag": "866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:30:01.346186 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:01.346665 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:01.347130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:01.358094 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] Creating event network-vif-plugged:866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99 for instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f on hv-cinder-86021 Oct 06 08:30:01.363261 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-ee90da57-2764-4550-b710-1e27c333a99a req-90501500-6b34-4b13-a56a-e3bcbc0ce367 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Oct 06 08:30:01.363789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 637/1257] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:30:01.996594 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:01.997203 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:02.004791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:02.005272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:02.005706 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:02.006393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:02.006845 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:02.007296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:02.139602 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:02.148527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-63410d04-4734-4a4c-bd13-35ba23202833 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.155745 Oct 06 08:30:02.149099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 621/1258] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:01 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:03.172447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:03.173223 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:03.183054 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:03.183606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:03.184076 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:03.187879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:03.188415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:03.188716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:03.331864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:03.340171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-96e54206-69dc-4518-8f08-3d2c7af19eac tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1265 microversion: 2.1 time: 0.172714 Oct 06 08:30:03.340778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 638/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:03 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:04.363792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:04.364393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:04.370382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:04.370857 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:04.371318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:04.371992 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:04.372436 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:04.372860 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:04.503194 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:04.510890 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f62c7836-b5b8-41f7-9955-9707f8c2a485 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1452 microversion: 2.1 time: 0.152168 Oct 06 08:30:04.511479 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 622/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:04 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:04.534169 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:04.534787 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:04.541085 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:04.541562 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:04.541995 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:04.542675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:04.543162 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:04.543588 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:04.672554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:04.680503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-dd32f9a5-22ff-4bd6-a3ee-7174f9ef5b94 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1452 microversion: 2.1 time: 0.151203 Oct 06 08:30:04.684853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 639/1261] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:04 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:06.693987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f", "tag": "866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:30:06.703965 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:06.704381 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:06.704814 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:06.715840 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] Creating event network-changed:866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99 for instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f on hv-cinder-86021 Oct 06 08:30:06.721671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-66d900d6-491c-464c-8f9e-94e9f75b88b6 req-1761250f-f965-43c8-b7b4-8db9bfac0034 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142438 Oct 06 08:30:06.722260 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 623/1262] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:30:34.376202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:30:34.377395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:34.379927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:30:34.380687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:30:34.388248 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:34.388734 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:34.389166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:34.389854 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:34.390302 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:34.390723 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:34.415002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lazy-loading 'flavor' on Instance uuid 63e4f359-18b8-4cf6-b6b0-f3f955b9599c {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:30:34.752568 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b843a10e-757d-41a4-a2a4-47dc448911f1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "POST /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c/action" status: 202 len: 0 microversion: 2.1 time: 0.380296 Oct 06 08:30:34.753183 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 640/1263] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:30:34 2022] POST /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:30:34.759564 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:30:34.770170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=76 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:30:34.770170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:34.770170 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:34.772583 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:34.773061 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:34.773495 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:34.774178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:34.774623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:34.775068 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:34.919818 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:34.928569 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ae649005-122c-47b0-a5cc-b86f8fe8bac0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.170537 Oct 06 08:30:34.929299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 624/1264] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:34 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:35.952518 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:35.953268 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:35.960654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:35.961129 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:35.961558 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:35.962251 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:35.962702 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:35.963154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:36.111569 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:36.117135 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-97c2bb24-39e3-40e8-a180-154b0c85e49b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.169483 Oct 06 08:30:36.117711 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 641/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:35 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:37.141232 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:37.142223 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:37.149764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:37.150254 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:37.150688 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:37.151470 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:37.151945 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:37.152371 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:37.292160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:37.300325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-02efea4e-ec09-45b9-8aa1-d7f7a1e93c73 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.163320 Oct 06 08:30:37.300932 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 625/1266] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:37 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:38.324712 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:38.325358 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:38.332803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:38.333286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:38.333746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:38.334565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:38.335136 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:38.335561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:38.470621 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:38.479271 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d1bed36a-faf1-4f5d-8d1b-c99b05102421 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.158575 Oct 06 08:30:38.479844 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 642/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:38 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:39.503215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:39.504049 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:39.510455 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:39.510934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:39.511393 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:39.512212 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:39.512684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:39.513080 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:39.647820 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:39.656628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-a11f8876-45cb-41a4-89d6-f3c07e758766 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.157899 Oct 06 08:30:39.657202 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 626/1268] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:39 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:40.680491 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:40.681112 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:40.687803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:40.688304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:40.688733 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:40.689510 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:40.690021 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:40.690590 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:40.908029 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:40.915858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a1924a8e-408f-446b-919a-e6688b8d9a07 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.239230 Oct 06 08:30:40.916440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 643/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:40 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:41.939078 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:41.939673 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:41.946174 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:41.946652 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:41.947110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:41.947794 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:41.948240 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:41.948658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:42.305387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:42.313446 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f7cbd2b7-3873-4bef-8111-56bf8f63153c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.377893 Oct 06 08:30:42.313810 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 627/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:41 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:43.336002 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:43.336607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:43.343109 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:43.347807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:43.347807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:43.347807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:43.347807 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:43.348208 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:43.475700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:43.487955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d5f9bb57-6e1a-4aea-b35e-ce6b49cfee5e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.152185 Oct 06 08:30:43.487955 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 644/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:43 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:30:44.508120 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:44.508724 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:44.515199 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:44.515702 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:44.516133 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:44.516811 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:44.517526 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:44.518469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:44.648633 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:44.656368 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4a2b6451-1b6d-43a1-b71a-9ebae3a3a0bc tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.152143 Oct 06 08:30:44.656930 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 628/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:44 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:30:45.679803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:45.680419 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:45.687063 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:45.687550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:45.687990 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:45.688680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:45.689141 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:45.689566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:45.821743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:45.829334 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7e3bc0a2-0d95-407c-a414-e68fc145a988 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.153425 Oct 06 08:30:45.829899 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 645/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:45 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:46.853325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:46.853934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:46.860609 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:46.861092 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:46.862481 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:46.863591 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:46.864337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:46.864730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:47.035160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:47.043239 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-5d8841fd-48f1-4413-be87-689e236234d1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.193901 Oct 06 08:30:47.043824 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 629/1274] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:46 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:48.067565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:48.068181 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:48.074914 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:48.075426 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:48.075856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:48.076540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:48.077014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:48.077460 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:48.212048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:48.219782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-e9c16d99-24f5-48c3-b781-1e732c38f4c0 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.156957 Oct 06 08:30:48.220346 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 646/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:48 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:49.242746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:49.243370 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:49.249861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:49.250336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:49.250760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:49.251461 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:49.251910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:49.252341 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:49.382412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:49.390325 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-3acd7db8-30ca-4980-86c7-0006ef1fa319 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1507 microversion: 2.1 time: 0.151394 Oct 06 08:30:49.390904 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 630/1276] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:49 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:49.414225 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:30:49.415427 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:49.421847 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:49.422335 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:49.422774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:49.423528 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:49.424014 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:49.424789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:49.440342 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "name": "network-vif-unplugged", "status": "completed", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:30:49.450956 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:49.456077 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:49.456077 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:49.463937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.compute.server_external_events [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] Unable to find a host for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c. Dropping event network-vif-unplugged {{(pid=121076) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 06 08:30:49.464816 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-9a9c9923-4ae4-4bec-9e50-398ee320ab16 req-472afcc6-161e-4236-b095-6c943eafff34 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028534 Oct 06 08:30:49.465404 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 631/1277] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 06 08:30:49.545122 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121077) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 06 08:30:49.803102 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [fd2d864c-7db1-47b3-8261-6971099a1295] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 08:30:50.811048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO oslo.messaging._drivers.impl_rabbit [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [fd2d864c-7db1-47b3-8261-6971099a1295] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40328. Oct 06 08:30:50.814707 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a089d4dd-672d-47a6-9214-df7e488f05a5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "POST /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c/action" status: 202 len: 0 microversion: 2.1 time: 1.404273 Oct 06 08:30:50.819355 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 647/1278] 10.222.0.30 () {60 vars in 1278 bytes} [Thu Oct 6 08:30:49 2022] POST /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c/action => generated 0 bytes in 1407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 06 08:30:50.824663 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:50.825280 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:50.833405 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:50.833898 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:50.834336 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:50.835081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:50.835535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:50.835990 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:50.971419 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:50.979172 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-bde97649-cf42-417d-866a-29c70fd73e50 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1515 microversion: 2.1 time: 0.158355 Oct 06 08:30:50.979751 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 632/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:50 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:52.003173 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:52.003814 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:52.010441 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:52.010960 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:52.011412 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:52.012130 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:52.012587 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:52.013017 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:52.144068 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:52.151941 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-a451aebc-287b-4710-b44d-86374fe57eb1 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1517 microversion: 2.1 time: 0.153416 Oct 06 08:30:52.152531 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 648/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:51 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:53.175752 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:53.176518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:53.183169 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:53.183649 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:53.184079 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:53.184768 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:53.185211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:53.185624 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:53.318512 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:53.326401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f92b3f67-916e-437a-84a3-a320aa32f525 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.154733 Oct 06 08:30:53.326977 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 633/1281] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:53 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:54.350606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:54.351239 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:54.357195 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:54.357670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:54.358098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:54.358778 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:54.359263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:54.359682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:54.489924 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:54.497716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0890b79f-a476-4f12-9be0-e6e1318911ac tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.152065 Oct 06 08:30:54.498288 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 649/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:54 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:55.521913 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:55.522514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:55.529231 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:55.529717 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:55.530154 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:55.530851 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:55.531351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:55.531775 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:55.663756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:55.671397 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-8a54061f-8049-444e-9590-ed86471aee1b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.154490 Oct 06 08:30:55.671973 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 634/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:55 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:56.694177 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:56.694800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:56.701326 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:56.701802 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:56.702235 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:56.702910 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:56.703385 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:56.703803 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:56.833606 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:56.841233 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-f1399896-b6b5-4414-a037-686cf0842216 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.150981 Oct 06 08:30:56.841789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 650/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:56 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:57.865434 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:57.866116 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:57.872792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:57.873277 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:57.873712 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:57.874428 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:57.874879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:57.875346 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:58.011772 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:58.019730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-914081af-55b8-4a30-a8e1-91778ee2b387 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.158771 Oct 06 08:30:58.020296 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 635/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:57 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:30:59.043561 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:30:59.044110 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:30:59.051420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:59.051895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:59.052323 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:59.053008 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:30:59.053454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:30:59.053872 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:30:59.181227 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:30:59.188948 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0a87f3ab-f3dc-4f8a-9db9-378fb2e9a902 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.149406 Oct 06 08:30:59.189604 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 651/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:30:59 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:00.212284 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:00.212924 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:00.219385 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:00.219863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:00.220294 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:00.222081 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:00.222542 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:00.222987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:00.353376 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:00.361933 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-ac720dfe-7fd3-433a-85c4-5f4bebd3846e tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.152975 Oct 06 08:31:00.362499 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 636/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:00 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:01.385318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:01.385858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:01.393289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:01.393832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:01.394398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:01.395127 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:01.395583 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:01.396009 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:01.529871 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:01.538677 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-65a6fc8a-dc0a-479c-800e-a8f1635fcc10 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.157260 Oct 06 08:31:01.539298 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 652/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:01 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:02.566345 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:02.566909 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:02.573398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:02.573872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:02.574299 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:02.575005 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:02.575452 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:02.575868 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:02.709815 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:02.717476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b5c5a46-6bd6-4cac-95ab-9ce677cfa2f5 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.155687 Oct 06 08:31:02.718047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 637/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:02 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:03.555262 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "name": "network-vif-plugged", "status": "completed", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:31:03.566713 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:03.567221 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:03.573639 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:03.581245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] Creating event network-vif-plugged:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:31:03.586301 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-5a00ac33-21c4-46b6-af97-878214c2c80a req-b204f470-c0f9-4123-8edf-01e9311f9f0b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034889 Oct 06 08:31:03.586986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 653/1290] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:31:03.740944 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:03.741535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:03.748251 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:03.748744 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:03.749184 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:03.749884 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:03.750337 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:03.750764 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:03.883511 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:03.891387 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b0754a87-c808-4ea3-b99f-42d73f0bcf52 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.154969 Oct 06 08:31:03.891958 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 638/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:03 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:04.915927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:04.916793 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:04.918503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:31:04.923682 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:04.930440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:04.930440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:04.930440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:04.930440 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:04.930858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:04.930858 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:31:05.059659 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:05.067776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-908ddb43-5d9d-4d03-b154-86a5b228357b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1573 microversion: 2.1 time: 0.156684 Oct 06 08:31:05.068343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 654/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:04 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:31:06.091347 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:31:06.091998 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:31:06.099200 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:06.099680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:06.100111 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:06.100792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:31:06.101237 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:31:06.101656 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:31:06.104215 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=87 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:31:06.235211 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:31:06.243559 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-86344dd1-02f3-439d-8860-1f1899e3ac71 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1560 microversion: 2.1 time: 0.156020 Oct 06 08:31:06.244126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 639/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:31:06 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:07.358492 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1704462424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1438726332", "security_groups": [{"name": "tempest-secgroup-smoke-374011883"}], "block_device_mapping_v2": [{"uuid": "61b495eb-0a60-48f3-b56e-d985cc6bfd0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d"}]}} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:07.370556 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 08:32:07.370705 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Thu Oct 6 08:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 06 08:32:07.475618 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.network.neutron [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] validate_networks() for [('8f1a0cc6-cb45-46fd-9d4c-50fc9cb5500d', None, None, None, None, None)] {{(pid=121077) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 06 08:32:07.847564 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 06 08:32:07.847988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image limits 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 06 08:32:07.848459 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Flavor pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 06 08:32:07.848859 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Image pref 0:0:0 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 06 08:32:07.849263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.virt.hardware [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121077) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 06 08:32:07.857971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:07.858443 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:07.858867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:07.859607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:07.860052 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:07.861300 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:07.877694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 06 08:32:07.881585 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.quota [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Getting quotas for user 79d29aa9482f4c1f9b1554333d85d80a and project fd1ef1a189d5485fb810e17c945b295f. Resources: {'instances', 'ram', 'cores'} {{(pid=121077) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 06 08:32:07.942571 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Going to run 1 instances... {{(pid=121077) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 06 08:32:07.944752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='61b495eb-0a60-48f3-b56e-d985cc6bfd0d',volume_size=None,volume_type=None)] {{(pid=121077) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 06 08:32:08.309969 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-7589bcd3-408a-4be0-a659-cf95aed7889b tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.956026 Oct 06 08:32:08.310615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 655/1294] 10.222.0.30 () {60 vars in 1147 bytes} [Thu Oct 6 08:32:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 06 08:32:08.320369 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=32 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:08.321218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=5 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:08.326126 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-fb5f740b-0768-4c6d-9ee1-99c6c2aacab7 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:08.340737 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-fb5f740b-0768-4c6d-9ee1-99c6c2aacab7 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:08.383642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-fb5f740b-0768-4c6d-9ee1-99c6c2aacab7 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:08.391239 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-fb5f740b-0768-4c6d-9ee1-99c6c2aacab7 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1095 microversion: 2.1 time: 0.072788 Oct 06 08:32:08.391839 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 640/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:08 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:09.414743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:09.415353 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:09.422048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:09.422534 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:09.423696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:09.424401 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:09.424856 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:09.425282 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:09.485522 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:09.493287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-92757cb1-2a2b-4f04-9a8a-2ec1a274ddeb tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1145 microversion: 2.1 time: 0.083059 Oct 06 08:32:09.493864 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 656/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:09 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:10.516679 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:10.517710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:10.525846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:10.526338 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:10.526779 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:10.527514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:10.527975 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:10.528401 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:10.591135 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:10.599323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2f7780f7-1953-4c29-92fd-f6a7678dfbb0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1201 microversion: 2.1 time: 0.087000 Oct 06 08:32:10.600000 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 641/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:10 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:11.623853 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:11.624619 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:11.631116 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:11.634649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:11.634649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:11.634649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:11.634649 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:11.635289 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:11.799198 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:11.806800 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-136748fd-85ec-4573-a176-9e592bf573fa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1278 microversion: 2.1 time: 0.186971 Oct 06 08:32:11.807473 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 657/1298] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:11 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:12.215324 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e58888-661e-4456-a5e2-50d9b4e26985", "tag": "d513acf9-d9ef-4282-b642-c23ec2879011"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:12.225639 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:12.226110 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:12.226534 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:12.238382 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] Creating event network-changed:d513acf9-d9ef-4282-b642-c23ec2879011 for instance 50e58888-661e-4456-a5e2-50d9b4e26985 on hv-cinder-86021 Oct 06 08:32:12.243776 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-1c55ed04-4999-4cf2-b221-9075ef4e8537 req-9d6800cd-a60b-42ef-a2ef-447abe881fdb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033364 Oct 06 08:32:12.244378 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 642/1299] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:32:12.833752 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:12.834424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:12.840727 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:12.841207 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:12.841641 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:12.842331 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:12.842882 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:12.843644 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:13.045667 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:13.053576 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-0063ff83-53fc-4eef-806b-87efaabdb27e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.223765 Oct 06 08:32:13.055402 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 658/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:12 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:14.077760 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:14.078480 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:14.085798 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:14.086272 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:14.086701 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:14.087595 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:14.088042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:14.088459 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:14.224582 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:14.232311 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-525ff960-38c4-4fcd-a413-a0e272470807 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.158775 Oct 06 08:32:14.232910 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 643/1301] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:14 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:15.256159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:15.256694 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:15.263098 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:15.263582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:15.264043 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:15.264745 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:15.265191 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:15.265614 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:15.397675 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:15.405279 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-102ec500-aac1-491c-96e9-59ae21002897 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.153080 Oct 06 08:32:15.405841 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 659/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:15 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:16.428722 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:16.429358 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:16.435318 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:16.435792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:16.436351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:16.437031 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:16.437476 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:16.437894 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:16.567979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:16.575588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-c4012b9a-ba21-4d51-a44c-64ade486cdfc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.151085 Oct 06 08:32:16.576148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 644/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:16 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:17.598356 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:17.599016 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:17.605398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:17.605879 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:17.606314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:17.607026 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:17.607478 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:17.607897 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:17.739704 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:17.747395 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9cd28c66-836c-4865-8621-a38a5f09fff0 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.153557 Oct 06 08:32:17.747965 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 660/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:17 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:18.770255 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:18.770850 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:18.773267 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell0:SELECT=2 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:18.778038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:18.778518 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:18.778978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:18.779657 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:18.780109 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:18.780535 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:18.912395 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:18.920042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-895cb1b5-ab47-4e4d-beaf-d6c24a978d07 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.154169 Oct 06 08:32:18.920618 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 645/1305] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:18 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:19.943674 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:19.944258 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:19.946160 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=2 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:19.946971 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell0:SELECT=6 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:19.952515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:19.952997 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:19.953431 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:19.954782 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:19.955292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:19.955716 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:20.084542 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:20.092151 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-5820dee6-ac38-4d2a-a1c8-bf02f20599ed tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.152308 Oct 06 08:32:20.092718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 661/1306] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:19 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:21.115406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:21.116009 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:21.122323 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:21.122804 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:21.123269 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:21.123957 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:21.124411 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:21.124835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:21.257756 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:21.265439 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2b7e5f4d-4c79-43b9-855d-28ae58a78b46 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.153897 Oct 06 08:32:21.266007 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 646/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:21 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:22.288543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:22.289147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:22.295497 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:22.295974 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:22.296403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:22.297105 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:22.297548 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:22.297996 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:22.432698 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:22.441168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b828230c-457e-4a1a-adbe-6303625c78ef tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.156476 Oct 06 08:32:22.441746 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 662/1308] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:22 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:23.464047 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:23.464610 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:23.471389 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:23.471869 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:23.472301 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:23.472979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:23.473426 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:23.473847 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:23.602646 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:23.610988 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-feb61bb6-a04f-4a3a-b298-40311b76ff15 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.150248 Oct 06 08:32:23.611570 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 647/1309] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:23 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:24.254490 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e58888-661e-4456-a5e2-50d9b4e26985", "name": "network-vif-plugged", "status": "completed", "tag": "d513acf9-d9ef-4282-b642-c23ec2879011"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:24.264719 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:24.265287 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:24.265718 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:24.280484 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] Creating event network-vif-plugged:d513acf9-d9ef-4282-b642-c23ec2879011 for instance 50e58888-661e-4456-a5e2-50d9b4e26985 on hv-cinder-86021 Oct 06 08:32:24.286507 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-6154b51a-3653-4d94-9a6a-82935ed7c657 req-4da9b22b-c9a1-4085-93cf-0d8ff1165f1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099910 Oct 06 08:32:24.287222 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 663/1310] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:32:24.633599 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:24.634308 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:24.640665 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:24.641138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:24.642072 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:24.643042 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:24.643490 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:24.643905 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:24.777929 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:24.786266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-dd522713-0c67-4a19-85f7-1ef502459845 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.156533 Oct 06 08:32:24.786827 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 648/1311] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:24 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:25.809095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:25.809789 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:25.816927 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:25.817409 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:25.817846 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:25.818529 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:25.819006 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:25.819432 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:25.953304 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:25.962686 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-b019753c-b3df-49f7-ac42-30328b912fd9 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1266 microversion: 2.1 time: 0.157797 Oct 06 08:32:25.963305 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 664/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:25 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:26.985454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:26.986140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:26.992638 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:26.993122 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:26.993611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:26.994469 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:26.994978 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:26.995406 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:27.123131 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:27.131148 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f01fc28b-0e97-4b13-abc8-991823045d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1453 microversion: 2.1 time: 0.149721 Oct 06 08:32:27.131710 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 649/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:26 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:27.153654 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:27.154263 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:27.161554 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:27.162032 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:27.162464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:27.163166 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:27.163615 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:27.164209 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:27.292959 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:27.300930 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-6920c366-f0a9-4cca-b544-066a11697cb2 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1453 microversion: 2.1 time: 0.151140 Oct 06 08:32:27.301540 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 665/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:27 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:29.561138 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e58888-661e-4456-a5e2-50d9b4e26985", "tag": "d513acf9-d9ef-4282-b642-c23ec2879011"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:29.571985 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:29.572454 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:29.572879 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:29.586894 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] Creating event network-changed:d513acf9-d9ef-4282-b642-c23ec2879011 for instance 50e58888-661e-4456-a5e2-50d9b4e26985 on hv-cinder-86021 Oct 06 08:32:29.592002 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-3c15b08e-c1da-4c14-a5d6-dacc10a178be req-189827f3-d38a-4573-a5eb-51bb112dbbf8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034511 Oct 06 08:32:29.592588 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 650/1315] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:32:36.423083 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:36.423710 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:36.430584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:36.430782 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:36.431843 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:36.432498 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:36.433424 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:36.434069 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:36.434683 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:36.440274 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:36.443658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:36.443658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:36.452501 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] Creating event network-changed:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:32:36.458022 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-8ba8219a-4433-4ab2-909c-49607f727ac8 req-c2544c41-c412-4e4b-b86e-26c05b8c428b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Oct 06 08:32:36.459098 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 651/1316] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:32:36.465286 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:32:36.726680 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-9fa38744-3e7f-43f4-95c1-fb3f8c9f5e5b tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "DELETE /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 204 len: 0 microversion: 2.1 time: 0.307813 Oct 06 08:32:36.727446 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 666/1317] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:32:36 2022] DELETE /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:32:36.737420 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:36.738386 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:36.746507 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:36.747309 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:36.747937 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:36.748861 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:36.749351 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:36.750178 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:36.893409 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:36.902241 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-1b2efd90-857e-4621-a672-427284d44b25 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.170022 Oct 06 08:32:36.902832 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 652/1318] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:36 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:37.926965 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:37.927684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:37.930165 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:37.934831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:37.935341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:37.935774 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:37.936464 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:37.936918 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:37.937345 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:37.944390 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:38.125214 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:38.133607 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-17e705b5-42fa-4051-97ba-63d037f1277a tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1566 microversion: 2.1 time: 0.211585 Oct 06 08:32:38.134190 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 667/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:37 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1566 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:39.157813 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:39.158548 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:39.161028 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=29 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:32:39.165723 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:39.166198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:39.166631 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:39.167349 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:39.167797 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:39.168218 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:39.235054 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:39.243414 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-09f93f4f-14f5-4ad4-8be4-65858ea28d35 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1379 microversion: 2.1 time: 0.089489 Oct 06 08:32:39.243994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 653/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:39 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1379 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:39.271862 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63e4f359-18b8-4cf6-b6b0-f3f955b9599c", "name": "network-vif-deleted", "tag": "8d68946d-3fba-427b-93fb-9782efea5551"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:32:39.281743 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:39.282747 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:39.283470 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:39.294283 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] Creating event network-vif-deleted:8d68946d-3fba-427b-93fb-9782efea5551 for instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c on hv-cinder-86021 Oct 06 08:32:39.299979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-27c0d91a-9916-4ba7-a8f0-3127c6c9c9c4 req-7a3040b0-43c6-4993-b799-ee99f278f5d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 Oct 06 08:32:39.304150 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 668/1321] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:32:40.267038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:40.267907 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:40.274327 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:40.274805 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:40.275273 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:40.277683 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:40.278155 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:40.278580 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:40.310522 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:40.311125 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:40.311553 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:40.311994 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lazy-loading 'fault' on Instance uuid 63e4f359-18b8-4cf6-b6b0-f3f955b9599c {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:32:40.354600 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6e390b824c41bc91fbd83f922cae97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc3f986a0af4426b9995cdcaa66c1b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:32:40.364848 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-649fe914-794d-4baf-a805-207f8bc5939c tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 200 len: 1220 microversion: 2.1 time: 0.101468 Oct 06 08:32:40.365514 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 654/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:40 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:32:41.389083 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:41.389696 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [instance: 63e4f359-18b8-4cf6-b6b0-f3f955b9599c] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:32:41.396202 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:41.396689 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:41.397168 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:41.397860 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:32:41.398318 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:32:41.398748 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:32:41.411921 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] HTTP exception thrown: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Request method failure captured: Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c HTTP/1.1 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpFrjK4iGjkuI4urbmn2KeRk4b2l0ajGx-yBYoAbwz4ORIvIA26w2x5T4-y2hwOgkTXW_ikoRJjQ-CJVD4zBrxWYZ-EfKI3g4VKJSdyaVeJRwB3pHMAh4egRBTxLtBWQEL4lpfvrIBuC1hpkc3Z72Kw1c7WndO3-hi7m6U2lCTgI5ng Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: 7cc3f986a0af4426b9995cdcaa66c1b0 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-TestShelveInstance-1946248646 Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:32:41.413546 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7cc3f986a0af4426b9995cdcaa66c1b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc3f986a0af4426b9995cdcaa66c1b0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7cc3f986a0af4426b9995cdcaa66c1b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7cc3f986a0af4426b9995cdcaa66c1b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-TestShelveInstance-1946248646 Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: 7cc3f986a0af4426b9995cdcaa66c1b0 Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-TestShelveInstance-1946248646 Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-TestShelveInstance-1946248646-project Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 3d6e390b824c41bc91fbd83f922cae97 Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-TestShelveInstance-1946248646-project Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. Oct 06 08:32:41.415454 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '63e4f359-18b8-4cf6-b6b0-f3f955b9599c'} Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:32:41.416594 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. Oct 06 08:32:41.418314 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:32:41.419867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Returning 404 to user: Instance 63e4f359-18b8-4cf6-b6b0-f3f955b9599c could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:32:41.419867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-d87cfa34-4a8c-48e3-ae48-74a1d7153655 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c" status: 404 len: 111 microversion: 2.1 time: 0.030746 Oct 06 08:32:41.419867 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 669/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:32:41 2022] GET /compute/v2.1/servers/63e4f359-18b8-4cf6-b6b0-f3f955b9599c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:32:41.650590 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-df59ea7a-83e3-458d-8ae5-643c79c9be47 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] Calling method '.version_select at 0x7f923f4a1d30>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:32:41.655412 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df59ea7a-83e3-458d-8ae5-643c79c9be47 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [f492ffc8-734f-4330-8b88-631851272c0a] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 06 08:32:42.663979 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO oslo.messaging._drivers.impl_rabbit [None req-df59ea7a-83e3-458d-8ae5-643c79c9be47 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] [f492ffc8-734f-4330-8b88-631851272c0a] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 40542. Oct 06 08:32:42.744033 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-df59ea7a-83e3-458d-8ae5-643c79c9be47 tempest-TestShelveInstance-1946248646 tempest-TestShelveInstance-1946248646-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-22774121" status: 202 len: 0 microversion: 2.1 time: 1.097286 Oct 06 08:32:42.744628 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 655/1324] 10.222.0.30 () {58 vars in 1248 bytes} [Thu Oct 6 08:32:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-22774121 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 06 08:34:18.292986 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_api:SELECT=5 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:34:18.297246 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_cell1:SELECT=74 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:34:18.298222 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG dbcounter [-] [121076] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=121076) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:34:18.298700 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG dbcounter [-] [121077] Writing DB stats nova_cell1:SELECT=9 {{(pid=121077) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 06 08:34:18.299858 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 06 08:34:18.302623 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Thu Oct 6 08:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Oct 06 08:34:18.308447 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:18.312319 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e58888-661e-4456-a5e2-50d9b4e26985", "tag": "d513acf9-d9ef-4282-b642-c23ec2879011"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:34:18.319551 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:18.326933 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:18.329691 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:18.329835 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:18.329941 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:18.330038 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:18.330139 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:18.330241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:18.330241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:18.330241 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:18.340503 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] Creating event network-changed:d513acf9-d9ef-4282-b642-c23ec2879011 for instance 50e58888-661e-4456-a5e2-50d9b4e26985 on hv-cinder-86021 Oct 06 08:34:18.345829 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-2944d733-b2d0-4ef6-bb8c-a4b79f9a215c req-8def5f62-85b4-4f9c-ac5f-3121dbe65d6e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050323 Oct 06 08:34:18.346634 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 656/1325] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:34:18.360253 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Going to try to terminate instance {{(pid=121077) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:34:18.644570 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-720dc1ff-8d30-4e92-be94-e0d2cdb9d0c1 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "DELETE /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 204 len: 0 microversion: 2.1 time: 0.353293 Oct 06 08:34:18.645366 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 670/1326] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:34:18 2022] DELETE /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 06 08:34:18.655863 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:18.656698 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:18.663286 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:18.664064 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:18.664755 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:18.665659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:18.666872 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:18.667390 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:18.808048 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:18.815888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-4b35c63e-3c26-45fa-81c5-3257dd4d1d4e tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1577 microversion: 2.1 time: 0.166069 Oct 06 08:34:18.816467 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 657/1327] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:18 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:19.840332 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:19.841064 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:19.847757 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:19.848245 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:19.848687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:19.849515 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:19.849975 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:19.850404 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:20.008230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:20.016642 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-146a1f5d-c2e4-42e3-97f3-7cea4e88b98c tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1577 microversion: 2.1 time: 0.180686 Oct 06 08:34:20.017215 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 671/1328] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:19 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:20.940410 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e58888-661e-4456-a5e2-50d9b4e26985", "name": "network-vif-deleted", "tag": "d513acf9-d9ef-4282-b642-c23ec2879011"}]} {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:34:20.950261 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:20.950730 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:20.951198 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:20.964259 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.compute.server_external_events [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] Creating event network-vif-deleted:d513acf9-d9ef-4282-b642-c23ec2879011 for instance 50e58888-661e-4456-a5e2-50d9b4e26985 on hv-cinder-86021 Oct 06 08:34:20.969517 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [req-543b4013-869f-4171-b339-fa044f3e157d req-a99033fc-99c3-4b3d-8da9-1a6ebd34ec4f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032684 Oct 06 08:34:20.970119 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 658/1329] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:34:21.039812 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:21.040998 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:21.047543 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:21.048023 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:21.048462 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:21.049147 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:21.049598 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:21.050025 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:21.126230 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:21.138458 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-64e1f441-cf4f-492d-b590-601c73ee9986 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1392 microversion: 2.1 time: 0.102300 Oct 06 08:34:21.139421 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 672/1330] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:21 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1392 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:22.170749 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:22.171478 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:22.178527 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:22.179036 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:22.179482 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:22.180160 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:22.180611 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:22.181059 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:22.213330 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:22.213934 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:22.214366 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:22.214828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.objects.instance [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lazy-loading 'fault' on Instance uuid 50e58888-661e-4456-a5e2-50d9b4e26985 {{(pid=121076) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:34:22.256165 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:22.264044 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f4c48945-a263-4da1-87b5-dcf00d8ebf87 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 200 len: 1231 microversion: 2.1 time: 0.098645 Oct 06 08:34:22.264620 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 659/1331] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:22 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:23.287574 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:23.288180 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 50e58888-661e-4456-a5e2-50d9b4e26985] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:23.294832 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:23.295343 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:23.295776 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:23.296451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:23.296895 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:23.297307 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:23.310203 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] HTTP exception thrown: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Request method failure captured: Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 HTTP/1.1 Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpEVT_xlQ55FvgcxSL758uKl1ja4OTnGz-5mheGasM-2FoSo5dDyxdcbLEN-8IzBUECbr3UCGVLtYMvasTuHPTexydyAfG7AQMtUWwGLL0RZ3Z6nKXlJBl1vHl00haRmbET9I0djd6IWt6M8iBFvBpbua8buJaBN50YzA9vPP5bAYTw Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:34:23.311833 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 79d29aa9482f4c1f9b1554333d85d80a Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. Oct 06 08:34:23.313653 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '50e58888-661e-4456-a5e2-50d9b4e26985'} Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:34:23.314670 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. Oct 06 08:34:23.316420 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:23.318132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Returning 404 to user: Instance 50e58888-661e-4456-a5e2-50d9b4e26985 could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:34:23.318132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-3c316be9-ec35-461f-aba6-0014c1428afa tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985" status: 404 len: 111 microversion: 2.1 time: 0.029516 Oct 06 08:34:23.318132 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 673/1332] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:23 2022] GET /compute/v2.1/servers/50e58888-661e-4456-a5e2-50d9b4e26985 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:34:26.904043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:26.904671 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:26.912140 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:26.912765 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:26.913352 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:26.914108 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:26.915197 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:26.917334 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:26.945746 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Going to try to terminate instance {{(pid=121076) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 06 08:34:27.117663 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f", "tag": "866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:34:27.127508 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:27.127988 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:27.128423 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:27.143231 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] Creating event network-changed:866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99 for instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f on hv-cinder-86021 Oct 06 08:34:27.148791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-d8019468-9eb1-41d1-a67b-633e12e299b3 req-49f850e4-98b8-45c9-a4f0-2874c6e9acd1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244713 Oct 06 08:34:27.150612 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 674/1333] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 06 08:34:27.247270 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-b21b1009-015c-4b39-9226-5676d84eacdc tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 204 len: 0 microversion: 2.1 time: 0.347052 Oct 06 08:34:27.247939 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 660/1334] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:34:26 2022] DELETE /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 06 08:34:27.256791 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:27.257550 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:27.264415 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:27.265148 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:27.265582 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:27.266275 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:27.266722 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:27.267170 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:27.443503 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:27.452701 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-478c13d3-09c0-48e0-af19-508951d59a6d tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1577 microversion: 2.1 time: 0.199961 Oct 06 08:34:27.453291 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 675/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:27 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:28.478067 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:28.479394 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:28.485792 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:28.486266 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:28.486695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:28.487391 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:28.487835 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:28.488247 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:28.620282 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:28.628099 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-7b053530-4335-414f-928d-47454a026d29 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1577 microversion: 2.1 time: 0.154360 Oct 06 08:34:28.628659 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 661/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:28 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:29.493015 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f", "name": "network-vif-deleted", "tag": "866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99"}]} {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 06 08:34:29.503347 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:29.503815 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:29.504234 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:29.515403 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.compute.server_external_events [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] Creating event network-vif-deleted:866a0396-e2b3-4bc3-8f4f-4d9bcb17aa99 for instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f on hv-cinder-86021 Oct 06 08:34:29.520433 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [req-6d04f798-13d3-4506-b415-f0b01ba8c0c4 req-cb51591c-7328-43d9-8c45-5c0d4499cde9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Oct 06 08:34:29.521058 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 676/1337] 10.222.0.30 () {64 vars in 1317 bytes} [Thu Oct 6 08:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 06 08:34:29.651899 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:29.652557 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:29.658962 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:29.659453 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:29.659891 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:29.660575 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:29.661027 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:29.661448 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:29.724927 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.policy [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121076) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:29.733416 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-6ecd17fc-85a2-4534-afef-397c5fc8cb31 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1225 microversion: 2.1 time: 0.086113 Oct 06 08:34:29.733987 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 662/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:29 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 06 08:34:30.756398 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:30.757095 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:30.763651 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:30.764131 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:30.764565 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:30.765444 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:30.765831 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:30.766256 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:30.797805 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:30.798265 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:30.798687 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:30.799159 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.objects.instance [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lazy-loading 'fault' on Instance uuid 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f {{(pid=121077) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 06 08:34:30.840666 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.policy [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79d29aa9482f4c1f9b1554333d85d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd1ef1a189d5485fb810e17c945b295f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121077) authorize /opt/stack/nova/nova/policy.py:199}} Oct 06 08:34:30.847484 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-1f32af91-f5d7-4fda-ae4c-21016045c303 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 200 len: 1184 microversion: 2.1 time: 0.095919 Oct 06 08:34:30.848062 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 677/1339] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:30 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 1184 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 06 08:34:31.870777 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:31.871398 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:31.877790 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:31.878264 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:31.878695 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:31.879396 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:31.879846 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:31.880262 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:31.893642 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] HTTP exception thrown: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Request method failure captured: Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f HTTP/1.1 Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpEVT_xlQ55FvgcxSL758uKl1ja4OTnGz-5mheGasM-2FoSo5dDyxdcbLEN-8IzBUECbr3UCGVLtYMvasTuHPTexydyAfG7AQMtUWwGLL0RZ3Z6nKXlJBl1vHl00haRmbET9I0djd6IWt6M8iBFvBpbua8buJaBN50YzA9vPP5bAYTw Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:34:31.895292 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 79d29aa9482f4c1f9b1554333d85d80a Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. Oct 06 08:34:31.897038 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f'} Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:34:31.898193 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. Oct 06 08:34:31.899878 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:31.901888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Returning 404 to user: Instance 7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:34:31.901888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-2f9d7086-4ec9-4de7-97e5-d87940aeb8bd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f" status: 404 len: 111 microversion: 2.1 time: 0.029729 Oct 06 08:34:31.901888 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 663/1340] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:31 2022] GET /compute/v2.1/servers/7d1c17bc-a9ed-4562-9e52-14b97ffbcf6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:34:32.415684 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:32.416171 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.compute.api [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121077) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:32.422632 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:32.423152 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:32.423584 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:32.424274 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:32.424729 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:32.425154 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG oslo_concurrency.lockutils [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121077) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:32.438048 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.wsgi [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] HTTP exception thrown: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Request method failure captured: Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: request: DELETE /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f HTTP/1.1 Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept: application/json Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Accept-Encoding: identity Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Connection: close Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Length: 0 Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Content-Type: application/json Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Host: 10.222.0.30 Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: Openstack-System-Scope: None Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: User-Agent: python-urllib3/1.26.12 Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Auth-Token: gAAAAABjPpEVT_xlQ55FvgcxSL758uKl1ja4OTnGz-5mheGasM-2FoSo5dDyxdcbLEN-8IzBUECbr3UCGVLtYMvasTuHPTexydyAfG7AQMtUWwGLL0RZ3Z6nKXlJBl1vHl00haRmbET9I0djd6IWt6M8iBFvBpbua8buJaBN50YzA9vPP5bAYTw Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Id: None Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Domain-Name: None Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Identity-Status: Confirmed Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Is-Admin-Project: True Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Id: default Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Domain-Name: Default Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Project-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Role: reader,member Oct 06 08:34:32.439737 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Roles: reader,member Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Id: default Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Domain-Name: Default Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Id: 79d29aa9482f4c1f9b1554333d85d80a Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: X-User-Name: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: method: > Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: exception: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.441442 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: action_args: {'id': '73331146-6ebd-4051-970c-554567f5c44f'} Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:34:32.445451 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.447088 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.449341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Returning 404 to user: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. {{(pid=121077) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:34:32.449341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-c56992a6-3f20-4acb-9545-ec0b19291c34 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "DELETE /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 404 len: 111 microversion: 2.1 time: 0.029336 Oct 06 08:34:32.449341 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 678/1341] 10.222.0.30 () {58 vars in 1239 bytes} [Thu Oct 6 08:34:32 2022] DELETE /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:34:32.450658 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '>' {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:32.451300 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.compute.api [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] [instance: 73331146-6ebd-4051-970c-554567f5c44f] Fetching instance by UUID {{(pid=121076) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 06 08:34:32.457210 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:32.457684 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:32.458113 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:32.458791 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Acquiring lock "19a0419b-ae97-4662-abef-e84eaae985c7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 06 08:34:32.459261 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 06 08:34:32.459680 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG oslo_concurrency.lockutils [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Lock "19a0419b-ae97-4662-abef-e84eaae985c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121076) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 06 08:34:32.473828 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.wsgi [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] HTTP exception thrown: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Request method failure captured: Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: request: GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f HTTP/1.1 Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept: application/json Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Accept-Encoding: identity Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Connection: close Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Length: 0 Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Content-Type: application/json Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Host: 10.222.0.30 Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: Openstack-System-Scope: None Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: User-Agent: python-urllib3/1.26.12 Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Auth-Token: gAAAAABjPpEVT_xlQ55FvgcxSL758uKl1ja4OTnGz-5mheGasM-2FoSo5dDyxdcbLEN-8IzBUECbr3UCGVLtYMvasTuHPTexydyAfG7AQMtUWwGLL0RZ3Z6nKXlJBl1vHl00haRmbET9I0djd6IWt6M8iBFvBpbua8buJaBN50YzA9vPP5bAYTw Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Id: None Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Domain-Name: None Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Identity-Status: Confirmed Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Is-Admin-Project: True Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Id: default Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Domain-Name: Default Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Project-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Role: reader,member Oct 06 08:34:32.475340 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Roles: reader,member Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/fd1ef1a189d5485fb810e17c945b295f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}] Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Id: fd1ef1a189d5485fb810e17c945b295f Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-Tenant-Name: tempest-TestVolumeBootPattern-1987727365 Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Id: default Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Domain-Name: Default Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Id: 79d29aa9482f4c1f9b1554333d85d80a Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: X-User-Name: tempest-TestVolumeBootPattern-1987727365-project Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: method: > Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: exception: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.477025 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: action_args: {'id': '73331146-6ebd-4051-970c-554567f5c44f'} Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: {{(pid=121076) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 06 08:34:32.478043 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. Oct 06 08:34:32.479721 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: ERROR nova.api.openstack.wsgi Oct 06 08:34:32.481158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: DEBUG nova.api.openstack.wsgi [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Returning 404 to user: Instance 73331146-6ebd-4051-970c-554567f5c44f could not be found. {{(pid=121076) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 06 08:34:32.481158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: INFO nova.api.openstack.requestlog [None req-f5c95a5d-7d22-425d-b495-78a4e9aacb66 tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f" status: 404 len: 111 microversion: 2.1 time: 0.030948 Oct 06 08:34:32.481158 dv-cinder-860212-3-iscsi devstack@n-api.service[121076]: [pid: 121076|app: 0|req: 664/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Thu Oct 6 08:34:32 2022] GET /compute/v2.1/servers/73331146-6ebd-4051-970c-554567f5c44f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 06 08:34:33.945292 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: DEBUG nova.api.openstack.wsgi [None req-2ae52982-c143-47cc-9f80-3570d2f3ebfd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] Calling method '.version_select at 0x7f923bcc8940>' {{(pid=121077) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 06 08:34:34.026979 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: INFO nova.api.openstack.requestlog [None req-2ae52982-c143-47cc-9f80-3570d2f3ebfd tempest-TestVolumeBootPattern-1987727365 tempest-TestVolumeBootPattern-1987727365-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1438726332" status: 202 len: 0 microversion: 2.1 time: 0.085648 Oct 06 08:34:34.027566 dv-cinder-860212-3-iscsi devstack@n-api.service[121077]: [pid: 121077|app: 0|req: 679/1343] 10.222.0.30 () {58 vars in 1263 bytes} [Thu Oct 6 08:34:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1438726332 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)